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ABSTRACT 



An image forming apparatus according to the present inven- 
tion comprises a scanner for optically scanning and reading 
a draft image, an image processing circuit for converting 
input image signals from this scanner to output image 
signals by referring to an image signal conversion table and 
outputting the converted signals, a laser optical system for 
writing image information on a photosensitive dnun in 
response to the output image signals, developing units for 
forming images with toner, an image signal generating 
means for generating a plurality of gradation patterns, acKl a 
CPU which prepares and selectors an image signal conver- 
sion table according to read signals for gradation patterns 
read by the scanner; wt)erein a read signal for a gradation 
pattern comprises a plurality of signals with different spec- 
tral sensitivity re^)ectively, and said image forming appa- 
ratus has a RAM to store odibration factors for the plurality 
of factors with different spectral sensitivity respectively and 
calibrates read signals according to a caHbration factor 
the RAM. 



12 Claims, 27 Drawing Sheets 
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[MAGE FORMING APPARATUS 

HELD OF THE INVENTION 

Hie present invention relates to an image forming appa- 
ratus such as a copying machine, a printer, and a facsimile 5 
machine each based on a digital system. 

BACKGROUND OF THE INVENTION 

Cbnventionally, in an image forming apparatus based on 
a digital system, an image signal conversion table (look up 
table: described as "LUT" hereinafter) has been used to 
correct output characteristics of an output device (an image 
forming means) such as a printer or to emphasize a particular 
density area. This image forming apparatus generally com- 
prises an image reading means, an image processing means, 
an image writing means, and an image forming means, and 
the LUT described above is incorporated in the image 
processing means, converts an input image signal inputted 
from the image reading means into the image processing 
means and outputs the converted signal as an output image ^ 
signal to the image writing means. 

On the other hand, the LUT is made reflecting output 
characteristics for image density of an image forming means 
such as a printer, so that, in a case where output character- 
istics of the printer has changed because of degradation or 25 
contamination of the image forming means or the like, the 
LUT can not play a role for calibration. 

To overcome the defect, as one of controls called process 
controls executed inside an image forming apparatus, a 
phuality of patterns each having different image density are 30 
formed on an image carrier such as a photosensitive body or 
a transfer body; the patterns are detected by an optical sensor 
by checking the reflected light or transmitted light to change 
charged potential, development bias, or an exposure to a 
laser beam according to a result of detection, or to correct a 35 
gradation calibration table for gradation conversion for 
image data. 

This calibrating method provides the merits that it enables 
automatic calibration within an image forming apparatus 
and that intervention by an operator is not required, but 40 
because of the characteristics of the optical sensor, there is 
no change in the side of high density where a quantity of 
deposited toner is large, so that calibration is possible only 
in a range from low density to intermediate density where a 
quantity of deposited toner is small. Further it is impossible 45 
to correct a quantity of toner which fluctuates according to 
change in a transfer capability of a transfer section associ- 
ated with passage of time or to correct fluctuation of image 
density caused by change in fixing capability of a Gxing 
section. 50 

In contrast, there has also been proposed a calibrating 
method in which a pattern image formed on an image carrier 
and transferred and fixed on a transfer member is read with 
a scanner and a gradation calibration table is selected or 
prepared according to the read data, or color conversion 55 
coefficients and an RGB-YMCK color conversion table are 
prepared. In this method, different from the calibrating 
method using an optical sensor as described above, inter- 
vention by an operator such as mounting a discharged 
transfer member onto a document base is required, but 60 
calibration of a high image density section where a quantity 
of deposited toner is large is possible, and there is provided 
the merit that change of image density due to change of 
fixing capability in the fixing section can be calibrated. As 
the calibrating method as described above, there has been 65 
known, for instance, the invention disclosed in Japanese 
Patent Laid-Open Publication No. HEI 5.114%2. 
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On the other hand, in a scanner used in an image forming 
apparatus like a color copyii^ machine, because of change 
during passage of time in spectral sensitivity of an RGB 
filter in a CCD (Charge Coupled Device) constituting the 
scanner or because of difference of spectral sensitivity in 
each image forming apparatus, even if the same color patch 
pattern or a gradation pattern is read, a value read by each 
scanner may vary from unit to unit. Description is made 
below for this phenomenon with reference to FIG. 32 
showing non-uniformity of spectral transmission character- 
istic of a B (Blue) filter in a CCD. 

In FIG. 32, a) indicates a spectral transmission factor of 
a B filter 1 in a CCD, b) indicates a spectral transmission 
factor of a B filter 2 in the CCD, c) indicates a ^ctral 
transmission factor of yellow (Y) toner, and d) indicates a 
spectral transmission factor of black (K) toner in a case 
where a quantity of deposited toner is small. The horizontal 
axis itxlicates a wavelength, while the vertical axis indicates 
a ^ectral transmission factor or a spectral reflection factor 
of the CCD. In this figure, a) and b) show an example of 
non-uniformity in a spectral transmission factor of the B 
filter. Herein it is assumed that the spectral transmission 
factors a) and b) have been shifted by a rate indicated at h) 
respectively, but the same consideration is applicable also to 
a case where the assumption as described above is not made. 

Namely, comparing the light transmitted through the B 
filter 1 in a) to the light transmitted through the B filter 2 in 
b) under the spectral reflection factor d) of black toner in a 
case where a quantity of deposited toner is small, a quantity 
of light having transmitted through the filter Bl is Uirger by 
a quantity of light havii^ transmitted through a region e), 
but is smaller by the light having transmitted through 
regions f) and g) as compared to a quantity of light having 
transmitted through the filter B2. Herein the ^ctral char- 
acteristics in a) and b) have been shifted by a rate in h) 
respectively, in a case of the light having transmitted through 
the B filter 1 in a), the quantity of light having transmitted 
through the region e) is equal to the quantity of light blocked 
by the regions f) and g), and for this reason a diflerenoe for 
a Blue signal between a) and b) is smaU as far as the black 
toner is concerned. 

To strictly examine the different above, it is necessary to 
take into considerations the spectral characteristics of the 
light source aixl dependency of sensitivity of a CCD on 
wavelength, but when calibrating shading of a scanner, by 
using an achromatic-colored reflection plate with low depen- 
dency of a spectral reflection factor for instance in gray on 
wavelength in a visible light area, the difference between a) 
and b) is cahljrated. 

However, in a case of yellow (Y) loner, the difference 
between filters in a) and b) appears as a difference of fight 
having transmitted through or having been blocked by the 
region g), and the difference is clearly larger than that in a 
case of black toner. Also the difference can not be calibrated 
even by a shading calibration using an achromatic-colored 
reflection plate. The non-uniformity in spectral transmission 
factors among filters in a CCD can be cahbrated in a case of 
achromatic colors like white or gray by means of shading 
calibration so that the RGB data become uniform, but in a 
case of a document with a spectral characteristic dependent 
on wavelength, the calibration can not be executed 
appropriately, and sometimes values for R, G, and B may 
vary unit by unit. 

The difference generates some influences when reading 
transfer paper with a gradation pattern of each color YMCK 
or color patch recorded thereon with a scanner and preparing 
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a gradalion calibratioo lable (y-calibration table) lo correct 
gradation characteristics of a printer section firom the read 
values (this operation is called Auto Color Calibration, and 
is described as ACC hereinafter)^ and offset Crom an ideal- 
istic state causes this phenomenon. Also in a case where the 
spectral transmission characteristic changes due to change of 
performance of a scanner in a CCD during passage of time, 
or in a case where the spectral reflection characteristics of 
YMCK toner being used changes, an RGB ratio in read 
values for the YMCK toner changes. As described above, if 
calibration is performed, after change of an RGB ratio in 
values read by a scanner for the YMCK toner, with an RGB 
ratio before the change, offset &om a correct value becomes 
rather larger. 

SUMMARY OF THE INVENTION 
It is a first object of the present invention to provide an 
image forming apparatus in which density of toner set after 
execution of ACC due to non-uniformity in spectral char- 
acteristics of a CCD in a scanner does not change for each 
apparatus and which can obtain good gradation by means of 
calibration. 

It is a second object of the present invention to provide an 
image forming apparatus in which calibration can be carried 
out with an appropriate value even in a case where the 
spectral transmission characteristic changes due to change of 
performance of a CCD in a scanner during passage of time, 
or in a case where the spectral reflection character of used 
YMCK toner changes. 

It is a third object of the present invention to provide an 
image forming apparatus in which a calibration value can 
easily be set 

It is a fourth object of the present invention to provide an 
image forming apparatus in which, by setting data for 
calibration of non-uniformity in spectral sensitivity among 
CCDs of discrete apparatuses with an external means, the 
non-uniformity can be calibrated by connecting this external 
means thereto. 

It is a fifth object of the present invention to provide an 
image forming apparatus in which a calibration value can 
easily be set against change in ^ctral transmission char- 
acteristic of a CCD or in spectral reflection characteristic of 
YMCK toner. 

An image forming apparatus according to the present 
invention comprises a scanner for optically scanning and 
reading a draft image, an image processing circuit for 
converting input image signals fmm this scaimer to output 
image signals by referring to an image signal conveision 
table and outputting the converted signals, a laser optical 
system for writing image information on a photosensitive 
drum in re^nse to the output image signals, developing 
units for forming images with toner, an image signal gen- 
erating means for generating a plurality of gradation 
patterns, and a CPU which prepares and selectors an image 
signal conversion table according to read signals for grada- 
tion patterns read by the scanner, wherein a read signal for 
a gradation pattem comprises a plurality of signals with 
different spectral sensitivity respectively, and said image 
forming apparatus has a RAM to store calibration factors for 
the plurality of factors with different spectral sensitivity 
respectively and calibrates read signals according to a cali- 
bration factor from the RAM. 

Other objects and features of this invention will become 
understood (rom the following description with reference to 
the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing electric configuration 
of an image processing section according to Embodiment 1 
of the present invention; 
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FIG. 2 is an organizational view showing an outline of a 
mechanism of the main body of a copying machine accord- 
ing to Embodiment 1; 

FIG. 3 is a view for explanation of a control system of the 
5 main body of the copying machine shown in FIG. 2; 

RG. 4 is a block diagram showing a laser modulator 
according to Embodiment 1; 

FIG. 5 is a flow chart for explanation of a sequence of 
preparing a gradation conversion table; 

FIG. 6 is a view for explanation of selecting curvature for 
the entire section; 

FIG. 7 is a view for explanation of the selected curvature; 

FIG. 8 is a view showing an example of a conversion 
IS curve for changing gradation characteristics in a highlight 
area; 

FIG. 9 is a flow chart showing operations for auto color 
calibration in an image density; 

FIG. 10 is a plan view showing an operating section; 
^ FIG. 11 is a plan view showing a liquid-crystal display 
screen of the operating section at the time of invoking an 
ACC menu; 

FIG. 12 is a plan view showing a liquid-crystal display 
^ screen of the operating section when the performance of the 
auto color calibration required for using a printer is selected; 

FIG. 15 is a plan view showing density gradation patterns 
on transfer paper when a print-start key is selected; 

FIG, 14 is a plan view showing a liquid-crystal di^lay 
30 screen of the operating section after the patterns are output- 
ted onto the transfer paper; 

FIG. 15 is a plan view showing a liquid-crystal dii^lay 
screen of the operating section during processing of auto 
color calibration; 

RG. 16 is a graph for explanation of calibration of a 
background color; 

FIG. 17 is a flow chart showing a sequence of preparing 
a gradation conversion table when the ACC is performed; 

FIG. 18 is a flow chart showing a sequence of selecting a 
gradation conversion table when the ACC is performed; 

FIG. 19 is a plan view showing a liquid-crystal display 
screen of the operating section for displaying RGB calibra- 
tion data; 

45 FIG. 20 is a schematic view showing an example of 
configuration for setting and inputting calibration values for 
RGB signals; 

RG. 21 is a block diagram showing elecuic configuration 
of the view shown in FIG. 20; 
50 FIG. 22 is a flow chart showing a sequence of preparation 
for setting and inputting calibration values for RGB signals; 

RG. 23 is a plan view showing an example of a color 
patch transferred onto transfer paper; 

RG. 24 is a block diagram showing another example for 
setting and inputting calibration values for RGB signals; 

RG. 25 is a flow chart showing a sequence of preparation 
for setting and inputting calibration values for RGB signals 
in RG. 24; 

RG. 26 is a schematic view showing another further 
example for setting and inputting calibration values for RGB 
signals; 

RG. 27 is a block diagram showing electric configuration 
of the view shown in RG. 26; 
65 RG. 28 is a block diagram showing electric configuration 
in a case where a toner patch is used in the configuration 
shown in FIG. 26; 
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FIG. 29 is a flow chart showing a sequence of preparation 122 by a reflecting mirror 121 to be introduced into an image 

for setting and inputting calibration values for RGB signals sensor array 123 of a CCD as a photoelectric transfer 

in the configuration shown in FIG. 27 and FIG. 28; element. Image signals converted to electric signals in the 

FIG. 30 is a flow chart showing another further sequence image sensor array 123 of a CCD oscillate a semiconductor 

of a case where calibration values for RGB signals are 5 laser in the laser optical system 104 through the image 

computed; processing apparatus not shown herein. 

FIG. 31 is a flow chart showing a sequence of preparing Next description is made for a control system of the 

a gradation conversion table when the ACC is performed; copying machine with reference to FIG. 3. FIG. 3 is a view 

and for explanation of the control system in the main body of the 

HG. 32 is a graph showing dispersion of spectral trans- ^° copying machine shown in FIG. 2. 

mission characteristics in a blue filter of a CCD based on the As shown in FIG. 3, the control system has a main control 

conventional technology. section (CPU) 130, and a ROM 131 and a RAM 132 to this 

main control section 130 are additionally provided therein. 

DESCRIPTION OF THE PREFERRED Connected to the main control section 130 are also a 

EMBODIMENTS 15 i^ser-optical system control section 134, a power supply 

Description is made hereinafter for embodiments, in circuit 135, an optical sensor 136, a toner density sensor 137, 

which a case where the image forming apparatus according an environment sensor 138, a photosensitive body surface 

to the present invention is applied to an electronic photo potential sensor 139, a toner supplying circuit 140, an 

copying machine (described simply as a copying machine intermediate transfer belt driving section 141, and an oper- 

hcreinafter) is assumed as an example, with reference to the ^ ating section 142 respectively through an interface I/O 133. 

related drawings. The laser system control section 134 adjusts laser output 

At first, description is made for a first embodiment of the laser optical system 104, and the power supply 

present invention. FIG. 2 is a schematic view showing circuit 135 gives a specified discharging voltage for electn- 

medianical configuration of the main body of a copying fication to the electrifying charger 103, gives a development 

madiine according to the first embodiment. bias at a specified voltage to tbe developing devices 105, 

In FIG. 2, successively arranged in the periphery of an ^^l^^^ ^J»' ^ ^ specified transfer voltage to 
organic photosensitive (OPC) d^n 102 havLg a diameter '^"^^ ^ ^ ^"^^^^ 
of 120 mm as an image carrier provided in substantially the op^cal sensor 136 comprises Ught-emitter such as 
center of tbe main body of the copying machine 101 are an 30 ligbl-emitting diodes or the like and Ught-receptors such as 
electrifying charger 103 for electrifying the surface of this photosensors or the like eadi provided adjacent to an area of 
photosensitive drum, a laser optical system 104 for irradi- ""age after being transferred from tbe photosensitive 
ating the surface of the uniformly electrified photosensitive drum 102. and a quantity of deposited toner in a toner image 
drum 102 with a semiconductor laser beam to fonn an a detection-pattern latent image formed on the photo- 
electrostatic latent image, a black^eveloping device 105 for 35 sensitive drum 102 and a quantity of deposited toner in the 
supplying toner for each cotor to tbe electrosUtic latent background color section are detected for each color 
image to be developed and obtaining each toner image in respectively, and so^alied potential residues on tbe photo- 
each color, three types of developing device 106, 107, 108 senative body after electrification thereon is removed is also 
for yellow Y, magenta M, and cyan C, an intermediate detected. 

traisfer belt 109 for successively trarsferring tbe toner 40 The detection output signal finom this photoelectric sensor 

images in each of the colors formed on tbe photosensitive 136 is applied to the photoelectric sensor control section not 

drum 102, a bias roller 110 for ^plying a traisfer voltage to shown herein. The photoelectric sensor control section com- 

this intermediate transfer belt 109, a cleaning device 111 for putes a ratio between the quantity of deposited toner in the 

removing toner residues on the surface of the photosensitive detection-pattern toner image and the quantity of deported 

drum 102 after the toner image is transferred onto transfer 45 toner in the background color section, compares the ratio 

paper, and a charge-removing section 112 for removing value to the reference value to detect fluctuation in an image 

charge residues on the surface of the photosensitive drum density, and corrects tbe control values for the toner density 

102 after the toner image is transferred thcreonto. Provided sensor 137. 

therein are also a transfer bias roller 113 for applying a Further, the toner density sensor 137 detects a toner 

voltage for transferring the toner image transferred along the 50 density according to changes of magnetic permeability in a 

intermediate transfer belt 109 onto transfer paper and a belt developer existing in each of the developing devices 105 to 

cleaning device 114 for cleaning the image of toner residues 108. The toner density sensor 137 has a function of applying 

on the intermediate transfer belt 109 after tbe toner image is a toner supply signal with amplitude, in a case where the 

transferred onto the transfer paper. detected toner density value is compared to tbe reference 

A fixing device 116 for fixing the toner image by being 55 value and the toner density is found under tbe specified value 

heated or pressured is provided in the exit side of an edge which indicates a short of toner therein, corresponding to the 

section of a transfer belt 115 for transferring transfer paper shortage thereof to tbe toner supplying circuit 140. Tbe 

peeled from the intermediate transfer belt 109 after tbe toner potential sensor 139 detects a surface potential of the 

image on the intermediate transfer belt 109 is transferred photosensitive body 102 as an image carrier, and the inter- 

thereonto, and a paper feeder tray 117 is also attached to the 60 tnediate transfer belt driving section 141 controls driving of 

exit section of this fixing device 116. the intermediate transfer bell 109. 

A contact glass 118 as a document base arranged on the A developer containing M-toner and carrier is 

top section of the main body of a copying machine 101 and accommodated, for instance, in the magenta-developing 

an exposing lamp 119 for irradiating a document on this device 107 and is agitated in association with rotation of a 

contact glass 118 with scarming light are provided in the 65 developer agitating member 202M, so that the developer 

upper side of the laser optical system 104, and a reflected sucked up onto a sleeve 201M by a developer restricting 

light firom the document is led to an image-formation lens member is adjusted on the developing sleeve 201M. This 
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supplied developer rotates in the direction of rotation of the 
developing sleeve 201M as a magnetic briish while it is 
magnetically carried on the developing sleeve 201M. 
Similarly, developing sleeves 201C, 201Y, and 201B are 
provided for C-toner, Y-toner, and B-toner, agitated by 
agitating member 202Q 202Y, and 2Q2B, respectively, as 
shown in FIG. 2. 

Next description is made for electric configuration of an 
image processing section with the reference to a block 
diagram shown in FIG. 1. 

In FIG. 1, designated at the reference numeral 401 is a 
color scanner, at 402 a shading calibrating circuit, at 403 an 
RGB Y-cah*brating circuit, at 404 an image separating circuit, 
at 405 an MTF cah*brating circuit, at 406 a color conversion- 
UCR processing circuit, at 407 a scaling circuit, at 408 an 
image processing (creating) circuit, at 409 an MTF filter, at 
410 a Y-calibrating circuit, at 411 a gradation processing 
circuit, and at 412 a printer. 

A document to be copied is resolved into colors of G, 
B to be read by G, B to be read by the color scanner 401. 
Non-uniformity due to characteristics of an image pickup 
device or non^niformity in irradiation of a light source or 
the like are calibrated in the shading calibrating circuit 402. 
Read signals from the color scanner 401 are converted from 
data for reflection factors to data for brightness in the RGB 
y-calibrating circuit 403. Detemunation is made between a 
character section and a photographic section as well as 
between chromatic color and adiromatic color in the image 
separating circuit 404. Degradation of an MTF characteris- 
tics in an input system, especially in a high frequency area 
is calibrated in the MTF calibrating circuit 405. The color 
conversion-UCR processing circuit 406 comprises a color 
calibraticMi processing section for correcting a difference 
between color-resolution characteristics in the input system 
and ^>ectral characteristics of color materials in an output 
system and computing a rate of color materials for YMC 
required for faithful color reproduction and a UCR process- 
ing for replacing a section in which three colors of YMC are 
superimposed on each other with Bk (black). The color 
calibration processing in the color calibration processing 
section can be realized by performing matrix-operation as 
described below. 
Expression 1 
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Herein, R% G", B" indicate complements of R, G, B 
respectively. Matrix factors a j i arc decided depending on 
spectral characteristics of the input system and output sys- 
tem (color materials). Herein, an one-dimensional masking 
equation is used as an example, but by using a second term 
such as B"2, B" G", or further higher-term, color calibration 
can more precisely be executed. An operation expression 
may be changed according to a hue, or a Noigebauwer 
expression may be used. In any of the methods, Y, M, C can 
be obtained from values of B", G", R** (or may he B, G, R). 

On the other, the UCR processing can be executed by 
computing using the below equations for each color. 

r~Y-Q'miii(Y, M, Q (2) 

Ar-Af-a niin(K M, Q (3) 

C'-C-a minCJ; Af, C) (4) 

B)t^ min(K hf, Q (5) 
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In these equations from (2) to (5). a indicates a factor for 
deciding a rate for UCR, and when a is equal to 1 (a«*l), 
100% of UCR processing is executed. This a may be a 
specified value, or in a high-density section, for instance, a 

5 is close to 1 and in the highlight section, an image in the 
highlight section can be smoothed by making a closer to 0. 

A hue determining circuit 422 is connected to between the 
MTF caHbrating circuit 405 and the color conversion-UCR 
processing circuit 406. Determination is made in this hue 

10 determining circuit 422 as to which hue signal among 
RGBCMY an RGB image signal indicates, and a color 
conversion coefficient is selected according to each hue. 

In the scaling circuit 407, vertical and horizontal scaling 
is executed, and a repeat processing or the like is executed 

15 in the image processing (creating) circuit 408. Executed in 
the MTF filter 409 is processing for changing friequency 
characteristics of image signals such as edge enhancement 
or smoothing or the like according to a user's taste to an 
image such as a sharp image or a soft image or the like. 

20 Image signals are calibrated in the y-calibrating circuit 410 
according to characteristics of a printer 412. Processing such 
as eliminating a background color or the like can concur- 
rently be executed also in the y*<^^1>i'^ui6 circuit 410. 
Dither processing or pattern processing is executed in the 

25 gradation processing circuit 411. 

Provided therein are interfaces I/F 413, 414 for processing 
image data read by the scanner 401 in an external image 
processing imit or the like or outputting the image data from 
the external image processing unit to the printer 412. 

30 A CPU 415 for controlling the image proces^g circuit 
described above, a ROM 416, and a RAM 417 are connected 
to each other through a BUS 418. The CPU 415 iscormected 
to a system controller 419 through a serial I/F, aixl com- 
mands from the operating section or the like not shown 

35 herein are sent thereto. It should be noted that, in FIG. 1, the 
reference numeral 421 indicates a pattern generating circuit, 
the reference numeral 422 indicates a hue determining 
circuit, and the reference numeral 423 indicates a selector 
although particular description is not made therefor herein. 

40 Next descrq)tion is made for a laser modulator with 
reference to the blodc diagram shown in RG. 4. It is 
assumed herein that a write finequency is 18.6 MHz, and a 
scanning time for 1 pixel is 53.8 nsec. 8 bits of image data 
can be Y-converted with a look up table (JLUT) 451. The 8 

45 bits of image data are converted to a 8-value pulse width 
according to signals with the 3 bits at the highest end of the 
8 bits of image signal by a pulse width modulator (PWM) 
452, are subjected to 32-value power modulation according 
to signals with the 5 bits at the lowest end by a power 

50 modulator (PM) 453, and laser diodes (LD) 454 emit light 
according to the modulated signals. Light-emitting ampli- 
tude is monitored by a photodetector (PD) 455 to be cali- 
brated each one dot. 

It should be noted that the maximum vahie by a laser 

55 beam ampUtude can be changed to 8 bits (256 levels) 
discretely from image signals. A beam diameter (this beam 
diameter is ^)ecified as a width when the beam amplitude is 
attenuated to t/e2 while the beam amplitude at rest is the 
maximum value) in the main scanning direction to a size of 

60 one pixel is not more than 90%, and desirably 80%. In 
conditions of 400 DPI and 63.5 ^ per one pixel, a desirable 
beam diameter is not more than 50 /An. 

Description is made for a sequence of preparing a grada- 
tion conversion table (LUT) in the y-calibrating circuit 410 

65 with reference to the flow chart shown in FIG. 5. In this 
sequence, at first, curvature for the entire section is selected 
(step 1001), and then curvature for the low image density 
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(highlight) seclioQ and that for the high image deosity 
(shadow) section are selected (steps 1002, 1003). Then, the 
curvature for the entire section is multiplied by a factor 
IDMAX so that the image density has a desired value to 
prepare a gradation conversion curve (step 1004). 

Detailed description is made for the processing in the step 
1001 with reference to FIG, 6. FIG. 6 is a view for 
explanation of an operation for selecting curvature for the 
entire section. It is assumed herein that a gradation curve as 
a reference is A, gradation conversion for changing curva- 
ture for the entire section is B, gradation conversion for 
changing curvature for the highlight area (low density area) 
is CH, and gradation conversion for changing curvature for 
the shadow area (high density area) is CS. Then, assuming 
that the gradation curve obtained as a result of gradation 
conversion of the gradation curve A according to the gra- 
dation conversion B is E, and this result is described by the 
following expression of E-B and as (A). 

Outhne of the above expression can more specifically be 
described as follows using the format of a programming 
language C: 
Expression 2 
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is Pc.<P0+Pl)/2-(127.5, 127.5), (127, 127), or (128. 128), 
the control point P3 is obtained by the following expression: 



= {l27.5-rf/VT. 127.5 + rf jyfl) 



(6) 



With this expression, a gradation conversion curve P (d, t) 
can be obtained by the following expression: 



(7) 
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<List 1> 

typedef uitmte(256]; 
Tkble A, E; 

tot B( iiit A, in coivBtuic) 
{ 

tut value; 

/• Cbmpoting for rh*^^ "g curvstiue */ 
according to a degree of auvatnic 

return value; 

} 

Processing for changing 
/* fuIIQ : curvature for the entire section */ 
l^ble full(tnt curvature) 
{ 

/* curvature ia a degree of curve */ 
int i; 

for(i - 0; t < - 255; i+ +) 

Eli] - B( Alil curvature); 
return E; 

} 



Herein, B indicates a function for changing the curvature of 
A. 45 

As an example of this function, in a case of 8-bit image 
signals, it is possible to use a quadratic Pege function 
satisfying the following conditions of 0-B (0, n), 255oB 
(255, n) (n: an arbitrary integer). 

The Pege fuix;tion satisfying the above conditions is 50 
described as a quadratic Pbge curve from a straight line POPl 
connecting a starting point PO (0, 0) to an endpoint PI (255, 
255) as shown in FIG. 7, a straight line L intersecting this 
straight line POPl, and a control point P3. existing on this 
straight line L and setting a distance d from a point of the 55 
intersection of the straight line POPl and the straight line L 
to a parameter. 

In the function descnbed above, by proportioning a dis- 
tance d thereto according to an integer curvature which is an 
aigument of the function B, the curvature can be changed. 60 
Description is made for a case of a function for the straight 
line LI intersecting at right angles the straight line POPl and 
for a case of a function for straight lines L2 parallel to the 
vertical axis of the figure as examples. 

As for a control point in the fifst example, when a distance 65 
d to this point is set to a parameter to a central point Pc, of 
a line segment POPl made of both edge points PO, PI, which 



However, t is a parameter in a range of O^t^l. P (d, t) is 
given as a set (x, y) of input (x) and output (y) to the 
gradation conversion curve, so that, assuming that x»A&om 
the integer A given as an argument to the function B ( ), t is 
obtained from the expression (7), and the obtained t is 
substituted into the expression (7) again to obtain an output 
value y. 

Actually, in place of computing as described above each 
time, all the sets (0^x^255) are previously obtained, and by 
storing the values as a table in the ROM 416, a time required 
for computing can be reduced. Several sets (or some tens of 
sets) of this gradation calibration table arc stored in the 
ROM 416 by changing the curvature thereof A curvature is 
given by an argument curvature to the function B ( ). 

VS^th this feature, <List 1> is rewritten as follows: 



Expression 3 



const table_.maz - 9: 

typedcf int 'IU>le{256t 

T^lc A, E, B[table_^inaz - 9; 

Processing for changing 
/•Q: curvatuic oi the entire sectian 
l^le full(inl cuivattire) 

{ 

curvature specifies a degree 
/• of curve, */ 
int i; 

for (i - 0; i < - 255; i+ +) 

EJil - B(cuivaturel Afi] \ 
return E; 



/• cujvatuze is a degree of curve 
int curvature - 1 ; 
E fun( curvature); 



It should be noted that, in the example described above. 

Table max°9 is assimied, so tbat the table includes 9 lines 

each having a different curvature respectively. Also, in the 
example as described above, the Pege curve is used, 
however, in addition, a higher function or an index/a loga- 
rithmic function or the like can be used as required. 

Also in the processing in step 1002 and 1003, curvature 
for the low image density (highlight) area and a high image 
density (shadow) area can be changed by executing process- 
ing like that in step 1000. So the <List 1> can be rewritten 
to a more general form, as follows. 
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ExpressioD 4 



<list 3> 



coast table_iiux - 9; 

typedef int 1^614256]; 

'Kblc A, E, Bttablc_inax]; 

Processing for changing 
/* TnutsfonnQ: ciuvatuic 



Tiblc 
{ 



} 



Transform(Tkble Transformer, Tabic Original) 

This function executes curvature of the * 
gradatian conversion curve called Original * 
using the gradation conversion curve 

called lYans former V 

int l; 

foi(i - 0;i < - 255 ;i+ +) 

E[t] - Traasfonnei[ Original[i] ( 

retuio E; 



/• curvature is a degree of curve •/ 
int curvature - 1; 
E - Transforni( B(curvaturel» A); 
Curvature of gradation conversion curve A is 
changed using the gradation conveisioa curve 
[curvature] •/ 



10 
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When coDversioo of a highlight oooversioD curve CH (h) 
as well as of a shadow oonversioa curve CS (s) is executed, 
the expression can be described as follows: 
Expression S 



<List 4> 

const table_max 
typedef int TU)te(2569 ; 

Ttele A, B(tablc_niaxl, E, CHltablc_jnaxl CSttabIc_jnax]; 

Processing for 
/* T^ansfonnO: changing curvature - */ 
"Kblc Thuisforni( TUile Transfonnei; 'Ublc Original); 
mainO 

{ 

int curvature, h, s; 
/* Oirvature of a curve is changed by changing numerical values 

of curvature, h, s */ 

/* Curvature of the entire section is changed */ 
E Ttanfonn( B[curvaturc, A): 

Curvature of the low imagp density 
/'(highlight) section is changed */ 
E - TranformC CHIhl E): 

Curvature of high image density 
/* (shadowed) section is changed */ 
E ~ Ttanform( CS{s\ E): 

} 
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Also in this case, description is made for a case where 
conversion is made by using a function for the straight line 
LI intersecting at right angles the straight line POPl and for 
a case where conversion is made by using a function for a 
straight lines L2 (not shown herein) parallel to the vertical 
axis in the figure like in the case where conversion is made 
by using the quadratic Pege curve. 

A conversion curve for changing gradation characteristics 
for a highlight area is generated, for instance, as follows, as 
shown in FIG. 8. It is assumed that a starting point PO and 
an endpoint PI are set as follows: P(KO, 0) and Pl=(255, 
255), re^ctively, and that a first control point P2 is set to 
P2=(32, 32). The control point P3 in the example shown in 
FIG. 7 is obtained as follows by setting a distance d from the 
point of intersection of the straight line POPl and the straight 
line LI as a parameter: 

Also, the control point P3 in the second example is obtained 
as follows by setting a distance d from the point of inter- 
section of the straight line POPl and the straight line LI as 
a parameter: 



25 



By using these values from PO to P3, a gradation conversion 
curve P (d, t) is obtained through the following expression: 
Expression 6 
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In this expression, curvature, h, s indicate values for 
deciding curvatures for the entire section, highlight section, 
and shadow section. It should be noted that curvatures for 
the highlight section and for the shadow section are prepared 
independently from each other. 

A gradation conversion curve for changing curvature for 
a particular density area like in a highlight area and a shadow 
area is generated as described below. 60 

Namely, a gradation conversion curve is generated using 
a tertiary Pege curve from a straight line POPl between a 
starting point PO and an endpoint PI, a straight line L 
intersecting at right angles this straight line POPl, and a 
control point P2 existing on this straight line L and setting 65 
a distance d from a point of the intersection of the straight 
line POPl and the straight line L to a parameter. 



P(4 f>^*«'+3-« P-(l-r>4.3-P3((0 ^(l-/)^+'^*(l-0' 



(8) 



Herein, Pl=<255, 255) is set as an endpoint, but it is 
assumed that an end^int PI is set to a point on a line 
segment m: (0, 0)-(255, 255) such as Pl-<64, 64) or the like. 
In this case, a line segment not included in the line segment 
POPl on the line segment m is used as equivalence conver- 
sion for gradation conversion as it is, and areas other than the 
line segment function as a gradation conversion curve for 
changing curvature for particular density area like the high- 
light area as well as the shadow area. 

Next description is made for operations of auto color 
calibration (ACQ for an image density (gradation) with 
reference to FIG. 9 to FIG. 15. 

FIG. 9 is a flow chart showing operations for auto color 
calibration in an image density, HG. 10 is a plan view 
showing an operating section, FIG. U is a plan view 
showing a liquid-crystal display screen of the operating 
section at the time of invoking an ACC menu, FIG. 12 is a 
plan view showing a liquid-crystal display screen of the 
operating section when the performance of the auto color 
calibration required for using a printer is selected, FIG. 13 
is a plan view showing density gradation patterns on transfer 
paper when a print-start key is selected, FIG. 14 is a plan 
view showing a liquid-crystal display screen of the operating 
section after the patterns are outputted onto the transfer 
paper, and FIG. 15 is a plan view showing a liquid-crystal 
display screen of the operating section during processing for 
auto color calibration. 

Provided in the upper side of the main body of a copying 
machine are a plurality of operating buttons 304, as shown 
in FIG. 10, for executing various type of operations such as 
preparatory heating/mode clear, memory call, interrupt 
operation, color adjustment/registration, program, option, 
and area processiag or the like together with a start button 
301, a clear/stop button 302, a ten key 303 for setting the 
number of sheets to be copied or the like each in the front 
side of the contact glass U8. A display screen 305 of a 
liquid-crystal display unit (described also as a liquid-crystal 
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screen bereioafler) is also provided ihereon so lhal it is 
surrouoded by these buttoos. The display screen 305 bas a 
tablet function for outputting a signal by pressing a display 
point or contacting a display point. 

When an ACC menu is called on the liquid-crystal screen 5 
305 of the operating section 142 as shown in FIG. 10, the 
liquid-crystal screen 305 is switched from the display 
thereon to the display as shown in FIG. U. When [Execute] 
of the auto color calibration for "copying is used" or 
"printing is used** is selected, the display on the liquid- lO 
crystal screen 305 is changed to the display as shown in FIG. 
12. In a case where "copying is used" is selected, the 
gradation calibration table used when a copier is used is 
changed, and in a case where "printing is used" is selected, 
the gradation calibration table used when a printer is used is 15 
changed each according to reference data. 

Herein, when "print start" is selected on the display screen 
305 shown in RG. 12, as shown in FIG. 13, a plurality of 
density gradation patterns 311 corresponding to each of 
image quality modes for colors of YMCX, characters and 20 
photographs are formed on transfer paper 310 (step 2001 in 
FIG. 9). It should be noted that the reference numeral 312 
indicates a position specifying mark. The density gradation 
patterns are previously stored and set in the ROM of the 
computer 420 shown in FIG. 1. A written value for a pattern 25 
has 16 patterns such as OOh, llh, 22h, . . . EEh, FFh 
displayed in hexadecimal digit. In FIG. 13, a patch for 
gradation except a background color section is displayed, 
and an arbitrary value, of 8 bits of signal in OOh to FFh, can 
be selected. In the character mode, dither processing such as 30 
pattern processing is not executed, but a pattern is formed in 
256 levels per one dot, while in a photogr^h mode, a 
written value for a laser is formed by distributing a sum of 
write values by two pixels each adjacent to each other in the 
main scanning direction. 35 

Namely, processing of patterns in a case where a written 
value for a first pixel is nl and a written value £6r a second 
pixel is n2 are distributed as follows: 

In a case of nl-t'n2^255, 

a written value for the first pixel: nl-i-a2 ^ 

a written value for the second pixel: 0 

In a case of nl-*-n2>255, 

a written value for the first pixel: 255 

a written value for the second pixel: nl-i-n2-255 or, 45 

In a case of nl+n2^128, 

a written value for the fiist pixel: nl'i-n2 

a written value for the second pbcel: 0 

In a case of 128<nl+n2i256, 

a written value for the first pixel: 128 

a written value for the second pixel: nl+n2-128 

In a case of 256<nl+n2^383, 

a written value for the first pixel: nl+n2-128 

a written value for the second pixel: 128 55 

In a case of 383<nl-»-n2, 

a written value for the first pixel: 255 

a written value for the second pixel: nl+n2-255 
Fattero processing used for actual image fonning is used 
other than the above processing. 60 

After a pattern 311 is outputted onto transfer paper 310, 
a display on the display screen 305 is changed to a display 
as shown in FIG. 14 so that the transfer paper 310 is 
mounted on the contact glass 118. 

The transfer paper 310 with the pattern 311 formed 65 
thereon is placed on the contact glass 118 (step 2002 in FIG. 
9), and "read start** is selected on the display screen 305 as 
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shown in FIG. 14, then the scanner 401 runs, and RGB data 
for a YMCK density pattern 311 is read (step 2003 in FIG. 
9). In this processing, data for the pattern section and data 
for a background color section of the transfer paper 310 are 
read. 

The read value for the pattern 311 is calibrated using a 
RGB calibration value described in detail later (step 2004 in 
FIG. 9). In a case where processing is executed using data 
for a background color (step 2005 in FIG. 9), processing for 
background color data to read data is executed (step 2006 in 
FIG. 9), and in a case where the reference data is calibrated 
(step 2007 in FIG. 9), a YMCK gradation calibration table 
is prepared and selected (step 2009 in FIG. 9) after process- 
ing (step 2008 in FIG. 9) for a high-image density section to 
the reference data is executed. 

The processing is executed in each of the image quality 
modes such as for each color of YMCK (step 2010 in FIG. 
9), and for photographs and characters (step 2011 in FIG. 9). 
Chiring the processing, the display on the display screen 305 
is changed to that as shown in FIG. 15. A key for [return to 
the original value] is shown on the di^lay screen 305 as 
shown in FIG. 11 so that, in a case where the operator gets 
an undesirable result of image forming with the YMCK 
gradation calibration table after the processing thereof is 
finished, the operator can select the YMCK gradation cali- 
bration table before processing thereof is executed. 

Next description is made for calibration of a background 
color. 

There are two objects for calibration processing of a 
background color. One of them is to correct a whiteness 
degree of transfer paper used for ACC, and the other one is 
to correct color or the like of something on a rear surface of- 
the transfer paper or seen through the paper. Namely, the 
former is executed to eliminate the difference between 
whiteness degrees of used transfer paper because, even if 
images are formed at the same time in the same types of 
apparatus, values read by the scanner 401 are different &om 
each other. As a demerit generated when a whiteness degree 
is not calibrated, there is a case where a desired color 
reproduction can not be obtained because, if regenerated 
paper having a low whiteness degree is used for the ACC, 
and when a yellow gradation calibration table is prepared, 
calibration is executed so that a yellow element therein is 
reduced because regenerated paper generally contains a Lot 
of yellow element, and in a case where an image is copied 
onto art paper having a high whiteness degree with the 
calibration in the above state, an obtained image results in 
containing not much yellow element therein. 

The former is executed to eliminate a case where color of 
a pressure plate for pressing down transfer paper or the like 
is seen through the paper to be disadvantageously read by 
the scanner 401 and copied when the transfer paper used for 
the ACC is not thick enough in its thickness (paper 
thickness). For instance, in a case where an auto document 
feeder called as ADF is mounted in place of a pressure plate, 
a belt is used for carrying a document, paper has a low 
whiteness degree and sometimes has slightly grayish white 
because of a rubber based material used for this belt. In a 
case where the paper having the color described above is 
used, an image signal to be read is read as a signal for an 
image over which the density is apparently higher than 
original one, so that, when a YMCK gradation calibration 
table for the image is prepared, the density therefor is 
intentionally made lower by the degree to be the original 
one. In a case where thick paper having low permeability is 
used this time in the above state, the image is reproduced as 
one in a low density on the whole, so that a desirable image 
can not always be obtained. 
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To prevent ibe ioconvenieQce as described above, a image 
signal read firom the pattern section is calibrated according 
to an image signal &om the background color section of the 
paper 

However, there are some merits even in a case where the 
calibration as described above is not executed. Namely, in a 
case where transfer paper always containing a lot of yellow 
element as regenerated paper, the paper to which any cali- 
bration is not executed has better color reproduction to color 
with a yellow element. In a case where only thin transfer 
paper is used, there is the merit that a gradation calibration 
table matched to thin paper can be prepared. 

As described above, and as shown in RG. 11, keys for 
calibrating or not calibrating a background color are dis- 
played on the display screen 305 so that the calibration of the 
background color can be ON or OFF according to the user's 
conditions and taste. 

It is assumed that a written vahie for a gradation pattern 
formed on a photosensitive body is set to LD (i) (wherein 
i=0, 1, . . . 9), and a vector of read values for the formed 
pattern by the scanner 401 is set to v[t][iXr[tIi], g[t][i], 
b[tli5 (t=Y, C, or K, i=0, 1, . . . 9). It should be noted 
that, in place of (r, g, b), a gradation pattern may be 
described by brightness, chroma, hue angle (L*, c*, h*), or 
brightness, redness, blueness (L*, a*, b*) or the Iflce, It is 
also assumed that read values for white color as reference 
values previously stored in the ROM 416 or RAM 417 are 
set to vahies (r[W], g[W], b[W]). 

When it is assumed that a pattern number of a density in 
an image is set to the k-th pattern (for instance, a pattern or 
the like of which image density is highest is selected) read 
values for a pattern (Arftjk], ^t[k], Ab[tXk]) is obtained 
as follows &x>m read vahies (r[iji], rftii], b[t][i]) for RGB 
signals to each of YMCK toner: 
Expression 7 

Mitlk}^W}-litlk] (9) 

On the other hand, in the RAM 417, percentages of RGB 
elements in the read value for a pattern is stored for each of 
the YMCK toners as follows: 
Expression 8 

kislt\{s^G, or B: fYM C, or K\k[jit]i } (1 0) 

{k[slt]l} in expression (10) indicates that a decimal close 
to a numeral 1 is taken, but inside a copying machine, it is 
held as integer data as described below: 
Expression 9 

li[slthkt[sltyr{kl[slt] is an integer of n'O 

The data is, for instance, n-10, 2''-1024 or the like. The 
values for K[slt] which are calibration values for RGB 
signals obtained as described above are shown in Table 1. 



TABLE 1 

Calibration values for RGB sipnals:k Isl [tl 



8 


t 


R 


G 


B 


K 


1. 00 


1.00 


1.00 


C 


1.05 


1.00 


0.95 
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TABLE 1-coatioued 

Oilibialioii valuci for ROB 5ignal»:k fsl til 



s 


t 


R 


G 


B 


M 


1.00 


1.00 


1.00 


Y 


1.00 


1-00 


0.95 



Cahbration data for the RGB signals shown in Table 1 is 
displayed, as shown in FIG. 19, on ibc display screen 306 of 
the operating section in the main body of the copying 
machine 101, and those numerical values can be inputted by 
pressing down with a finger the corre^xjnding section in the 
display area. Inputted data is stored in the RAM 417. 

By using the values in the expressions (9), (10), the values 
v[lIiXr[tIi], g[tli], b[tli]) (t-Y, M, C, or K, i-0, 1, ... 9) 
^ read by the scanner 401 are calibrated as follows. Herein, 
description is made for a case of t-C (Cyan). RGB elements 
in the read values for cyan toner are calibrated as follows: 
Expression 10 

rl[Cli>4CI0]-M'I*]xA[rIfl 

25 

gl[Cli)-rfCI0>A5[fI*>c%If] 
61[CliH<ClO}-Ai(fI*>cAt6If] 

^ arxi, the caL*brated values are set to new values (r[tli], 
g[^Fl 3Lnd are used as follows. 

Next description is made for a method of gerserating a 
gradation conversion table (UJT) executed in the y calibrat- 
ing circuit 410 as a y conversion processing section when 
ACC is executed. 

In the read values for a pattern v[tli](r£tlil, g[tli], 
b[tli]), image signals for each complementary color of 
YMC toner are b[t][i], g[t][i], r[lli]rc^ectively, so that only 
image signals for complementary colors are used. Herein, to 
' make the description below simple, a[t][iXi=0, 1, ... 9; t«C, 
M, Y, or K) is used to be shown. A gradation conver^on 
table is prepared, which makes the processing simple. It 
shoukl be noted that, even if any image signal of RGB is 
used, sufficient precision can be obtained as far as blade 
toner is concerned, however, a G (green) element is used. 

The reference data is given by a set of values vO[tIiXjO 
[lli]. g<lll[»l read by the scanner 401 and the 

correi^onding write values LD[iX*^l» 2, ... 10) by a laser. 
Similarly, to make the description below simple, by using 
only complementary color image signals for YMC, the 
following expression is described: 
Expression 11 

Ar/I/<nX0M0^255, 1-1, 2, .... 10, f-K M C, or fC) 

55 A YMCK gradation conversion table can be obtained by 
comparing the a[LD] described above to the reference data 
A[n] stored in the ROM 416. Herein, n indicates an input 
value to the YMCK gradation conversion table, and the 
reference data A[n] indicates a target value for a read image 

60 signal that the YMC toner pattern outputted at a laser write 
value LD[i] after the input value [n] is subjected to YMCK 
gradation conversion is read by a scarmer. It should be noted 
that the reference data A[n] has two type of reference data, 
one of which is one for executing calibration according to an 

65 image density enabling output by a printer, and the other of 
which is one for not executing calibration. Determination is 
made as to whether cahbration is executed or not according 
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to the data for determinalioo, descnbed later, previously 
stored io the ROM 416 or the RAM 417. This calibratioD is 
descnbed later. 

By obtaining LD oorrespoDdiog to A[o] from the a[LD] 
described above, laser output values LD{q] correspODding to 
input values n to a YMCK gradation conversion table is 
computed. By computing laser output values with input 
values i«=0, 1, 2, . . . 255 (when it is 8 bits of signal), a 
gradation conversion table can be obtained. 

When it is operated, in place of the above processing to 
all the input values n=00b, 01b, . . . FFh (hexadecimal) to the 
YMCX gradation conversion table, the processing is 
executed only to some of the values like n[i]=0, lib, 
22h, . . . FFb by skipping some therebetween, and for values 
other than the above values, interpolation is executed by 
using a spline function or the like, or a table closest to the 
sets of (0, LD[0], [llh, LD[llh]]), (22h, LD[22h]]). . . . , 
(FFh, LD[FFh]]) each obtained by the above proces^ng 
among the YMCK y-calibration tables previously stored in 
the ROM 16 is selected. 

Description is made for the above processing with refer- 
ence to the graph shown in FIG. 16. FIG. 16 is a graph for 
explanation of calibration of a background color. The X-axLs 
in the upper right quadrant (a) of FIG. 16 indicates an input 
value n to the YMCMK gradation conversion table and the 
Y-axis therein indicates a value (after the processing) read 
by the scanner 401, which irxlicates the reference data A[l] 
described above. The value (after the processing) read by the 
scanner 401 is a value, in contrast to a value obtained by 
reading a gradation pattern by the scaimer 401, obtained by 
RGB Y-converting (conversion is not executed hereX aver- 
aging and adding the read data in some points of the 
gradation pattern, and the obtained value is processed herein 
as 12 bits of data to improve operational precision. The 
X-axis in the upper left quadrant (b) thereof indicates a value 
(after the processing) read by the scanner 401 like in the 
Y-axis. Hie Y-axis in the lower left quadrant (c) indicates a 
written value by a laser beam (UC)). This data a[LD] indi- 
cates characteristics of a printer. The write value by a laser 
beam (LD) ioi actually formed pattern includes 16 values in 
total such as OOh (a background color), llh, 22h, . . . , EEh, 
FFh, which indicate values by skipping therebetween, 
however, values not detected between the detected points are 
interpolated herein, so that the graph is regarded as a 
continuous graph. The graph in the lower right quadrant (d) 
thereof indicates a YMCK gradation conversion table LD[1] 
which is an object to be obtained. 

Values of the X-axis and Yraxis of the graph (f) are the 
same as those in the graph (d). In a case where a gradation 
pattern for detection is formed, the YMCK gradation con- 
version table (g) shown in the graph (f) is used. The X-axis 
of the last graph (e) is the same as that in the lower left 
quadrant (c), which indicates linear conversion for the 
convenience to show a relation between the write values of 
LD when a gradation patter is prepared and values read by 
the scanner 401 (after the processing). The reference data 
A[n] oorre^Mnding to an input value n is obtained from the 
graph shown in FIG. 16, and LD output LD[n] to obtain A[n] 
is obtained along the arrow (1) in the figure using the read 
value a[LD] for the gradation pattern. 

Next description is made for a sequence of operation with 
reference to FIG. 17. FIG. 17 is a flowchart showing a 
sequence of preparing a gradation conversion table when the 
ACC is executed. 

At first, input values required for obtaining a YMCK 
Y-caHbration table are computed (step 3001). Herein, it is 
assumed that n[l] is set to the following values: n[i]»ll [b] 



,071 

18 

xi (i-O, 1, . . . , imax-15). Then, the reference data A[n] is 
calibrated according to an image density in which an image 
can be outputted onto a printer 412 (step 3002). Herein, it is 
assumed that read values by a laser in which the maximum 

5 image density enabling preparation by the printer 412 can be 
obtained is set to FFh (indicated by hexadecimal) and the 
read value ai[FFh]for a pattern at this time is set to mmax. 
It is assimied that the reference data A[iXi=0, 1, . . . , il) is 
one with which calibration is not executed over the area 

10 fi'om the side of a low image density to the side of an 
intermediate image density, the reference data 
A[iXi-i2+l, . . . , i max) (i2^il, i2^i max-1) is one with 
which calibration is not executed in the side of a high image 
density, and the reference data A[i](i=il+1, . . . , i2) is one 

15 with which calibration is executed therein. 

In an example described below. Description is made for 
concrete method of computing assuming that a signal is an 
image signal to which RGB Y-conversion is not executed and 
which is proportional alto a reflection factor of a document. 

20 Of the reference data with which calibration is not executed, 
a difference Aref between the data is computed from the 
reference data A[i2+1] with the lowest image density in a 
high image density section as well as &om the reference data 
A[il] with the lowest image density in a low image density 

25 section. 

Namely, it is assumed as follows: 

A«MI'11-A[i2+1] (11) 

^ On the other hand, in a case of a reflection factor linear or 
a brightness linear in which RGB Y-conversion as reverse 
processing is not executed, Aref is larger than 0 (Aref>0). 
Similarly, a difference Adet is computed from the read value 
mmax for a pattern with which the maximum image density 
enabling preparation by the printer 412 can be obtained. 
Namely, it is assumed as follows: 

6det^a]-mmiai (12) 

^ From the expressions (11) and (12), it is assumed that the 
reference data A[iXi-il+l, • . . , i2) with which calibration 
is executed in a high density section is set to that as follows: 

AliMlilHA[(h*lilDjc(Aairi/An;0 (i-*l+l. »l+2, . . . , O-l. 

45 Then, the read image signal m[i] by the scaimer 401 
corre^nding to the n[i] obtained in step 3001 is obtained 
from the reference data A[n] (step 30iD3). Actually, the 
reference data, corresponding to values n[i] indicating not all 
the values to be detected, A[n[j]] (0^n[jp65, j-0, 1, . . . , 

50 j max, nO]=o[k] for j^k) is made as follows. Namely, j 
[O^j^j max] to be n|j]^n[i]<n(j+l] is computed. 

In a case of 8 bits of image signal, if the reference data is 
previously obtained as n [0]^, n[j max]- 255, n(j max+1]- 
n|j max]+l, A[j max+l]-A|j max], the computation 

55 becomes easier. 

As far as a space in the reference data is concerned, a 
space of nQ] as small as possible is better because high 
precision of the Y-cahbration table finally obtained can be 
achieved. 

5Q A value m[i] is obtained from the following expression 
using the value j computed as described above: 

mii]^by<Ah'^ii-mMQ-'ijWru*ihm (14) 

Herein, values arc interpolated with a linear expression, 
65 however, interpolation may be executed thereto with a 
higher function or a spline fiinction or the like. In that case, 
m[i] is obtained as follows: 
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Also, in a case of a k-th function, an expression is made as 
follows: 

Expression 17 ^ 

10 

Then, write values LD[i] by LD to obtain m[i] cooiputed 
in step 3003 is obtained according to the same sequence as 
that in step 3003 (step 3004). 

Namely, in a case where image signal data which is not 
subjected to RGB y-conversion is processed, a value of is 
afLD] is smaller as a value of LD is larger. Namely, the 
expression is as follows: 

in contrast to LD[k]<LD[k+l], 

flfU)f*]l^flfJUJ(*+lll 20 

Herein, it is assumed that values when a pattern is formed 
are set to 10 values such as LD[k}-00h, llh, 22h, . . . , 66h, 
88h, AAh, FFh, (k-0, 1, .... 9). That is because spaces 
between write values LD [k] for a pattern are Darrow since 
fluctuation of read values by the scanner 401 to a quantity of ^ 
deposited toner is large in an image density with small 
quantity of deposited toner, and because spaces therebe- 
tween are wictened for reading since fluctuation of read 
values by the scanner 401 to a quantity of deposited toner is 
small in an image density with large quantity of deposited 
toner. 

As some merits provided by the above processing, a 
pattern is formed with the write values by LD as described 
above because consumption of toner can be reduced as 
compared to a case where the number of patterns is 
increased such as LD[k]-00h, llh, 22h. . . . , EEh, FFh (16 
in total) or the like, fluctuation to write values by LD is small 
in a high image density area, and a narrow space between 
write values by LD is not always effective to improve the 
precision thereof because read values are easily reversed due ^ 
to influence of a non-uniform potential on the photosensitive 
body, non-uniform deposited toner thereon, and a non- 
uniform potential on toner or the like thereover. 

Herein, the following expression is obtained: 

To LD[k] satisfying the condition of 

When the expression is set to O^k^k max [kmax>0], and 
in a case of a[LD[k max]]>m[i] (in a case of a high image 
density in the target value obtained from the reference data), 

[L0(hiiaz]]-a{ZJ)[Ama8-l ID 

55 

the above expression is made, and a pattern is estimated by 
extrapolation with a linear expression. 

With this processing, a set [n[i], LD[i]] (i-0, 1, . . . , 15) 
of input values n[i] to a YMCK y-calibration table and 
output values LD[i] is obtained. 60 

'llieo, based on the obtained values [n[i], LD[i]] 
(i"0, 1, . . . , 15), interpolation is executed with a spline 
function, or the y-calibration table stored in the ROM 416 is 
selected (step 3005). 

Next, a method of selecting a y-calibration table is 65 
described in relation to preparation of the calibrated grada- 
tion curve described above with reference to RG. 18. FIG. 
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18 is a flowchart showing a sequence for selecting a grada- 
tion conversion table during execution of ACC. 

At flist, coefficient IDMAX [%] applied to the entire 
Y-calibration table (step S4001) is computed. Herein in a 
case of n [imax]=FFh, IDMAX is set to LD[iniax]/FFhxlOO 
[%]. Also herein an output value LD[i] to the YMCK 
Y-calibration table is rewritten assuming LD'[i}:»LD[i]xlOO/ 
IDMAX. With the operations, there is no necessity to take 
into considerations the IDMAX in selection of a 
Y-calibration table. 

Then curvature h, and s, which are indices for curved 
section of the whole section, highlight section, and shad- 
owed section respectively, arc selected. For that purpose, at 
first, the curvature m for the whole section is selected (step 
S4002). Basically m is selected so that a sum of square of 
errors between the finally obtained gradation conversion 
curve E|j] (Oiji255) and a set (n[i], LD[i]) (0^i^l5) of 
the input value n[i] into the YMCK Y-calibration table and 
the output value LD[i] (described as error hereinafter) will 
be minimum ^ 

ciror^2:H'i(ZJD[i)-£lrt[i'n)^ 

wherein wi is weight to an input value to the i-th YMCK y 
calibration table. In this step, if an error for the highlight 
section is large, a desired result can not be obtained, so that 
the weight wi for the highlight section is made larger to 
make the error as small as possible. 

Similarly, curvature b for a highlight section which should 
have a minimum error is obtained (step S40Q3), and then 
curvature s for a shadowed error which should also have a 
minimum error is obtained (step S4004). Tbe~(h^min, 
m_jnin, s_min) obtained as described above and IDMAX 
are used as new curvature of the calibrated gradation curve. 

Next description is made for a method of setting a 
calibration value for RGB signals with an external device 
arxi a particular example of input data from the device with 
reference to FIG. 20 through RG. 23. FIG. 20 is a general 
blodc diagram showing an example of configuration for 
setting and inputting calibration values for RGB signals; 
FIG. 21 is a block diagram showing electric configuration of 
the system shown in FIG. 20; FIG. 22 is a flow chart 
showing a sequence for setting and inputting calibration 
values for RGB signals in a form according to the secotxl 
embodiment of the present invention; and FIG. 23 is a flat 
view showing an example of color patch transferred onto 
transfer paper. 

As shown in FIG. 20, a computer 321, which is a 
computing device for computing calibration values for RGB 
signals, is connected with a wired communication means to 
the main body of copying machine 101 so that bi-directional 
communication can be made. The computer 321 comprises 
a computer for control which can also process data. It should 
be noted that the main body of copying machine 101 and the 
computer 321 may be connected to each other with a radio 
communicating means. Copying machine 101 is arranged to 
accept a YMCK color patch 324 and dischai^ge a transfer 
paper 311, as described hereinafter. 

As shown by the block diagram in FIG. 21, the main body 
of copying machine 101 has a non-volatile RAM 322, and 
reads color patch having a known ^jectral reflection char- 
acteristic, A memory device 323 is connected to the com- 
puter 321. 

To describe a sequence for preparing calibration values 
for RGB signals with the devices with reference to the 
flowchart shown in RG. 22, a YMCK color patch 324 
having a known spectral reflection characteristics is placed 
on a contact glass 118 of the main body of the copying 
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machine (step S5001). The color patch 324 comprises a To know the spectral refleaion characteristic, the ^clral 

coior patch printed with YMCK ink or the like when reflection characteristic p(t, X) (wavelength K [n m], t-W, Y, 

transferred onto transfer paper 311 as shown in FIG. 23. M, C, or B) is measured using the spectrographic color 

FIG. 23 shows two types of color tone for each of YMCK, measure or the like, and at the same time it may be computed 

but the color tone may be one type. Then with the scanner 5 from the spectral transmission characteristic x [s, X-Xs-R, G, 

401 of the main body of the copying machine 101, the color or B) of a standard CCD as well as from the spectral 

patch 324 is read, and read values for RGB signals are characteristic E0(>.) for a standard light source through the 

obtained (step S5002). The read values for this color patch following expression. 

324 are down-loaded to a computer 321 which is an external * i . r^«x / /i <a 

computing device (step S5003). lo -a * j-- /k^ . y v . 

The read values V[tIsXt-W, Y, M, C, or K: s=R, G, or B) wherein A is a proportional al constant, and X is a wave- 

for RGB signals for the color patch 324 down-loaded to the length. 

computer 321 are compared to the read values vO[t Js] (t^Y, Next description is made for still another example of a 

M, C, or K; s«R, G, or B) for RGB signals read with a CCD case where cah*bration values for RGB signals are computed 

having a standard spectral characteristic, and a ratio k[t][s] is using the expression (18) with reference lo FIG. 26 and FIG. 

(t-Y, M, C, or K; s-R, G, or B) for each is obtained (step 29. FIG. 26 is a general block diagram showing still another 

S5004). It should be noted that this computing may be example of configuration for setting and inputting calibra- 

executed in the side of the main body of the copying tion values for RGB signals; RG. 27 is a blodc diagram 

machine 101. Then calibration values for RGB signals showing electric configuration of the system shown in FIG. 

obtained from the computer 321 are up-loaded to the main 20 26; FIG. 28 is a blodc diagram showing electric configura- 

body of the copying machine 101 (step S5005), and the main tion of a case where a color patch prepared with toner in the 

body of the copying machine 101 stores the obtained cali- configuration shown in FIG. 26 is used; and FIG. 29 is a flow 

bration values for RGB signals in the non-volatile RAM 322 chart showing a sequence for setting and inputting calibra- 

(step S5006). tion values for RGB signals in FIG. 27 and FIG. 28. 

Calibration values for RGB signals are prepared with the 25 The configuration shown in FIG. 26 are the same as that 

computer 321 as described above, and the calibration values shown in FIG. 20 excluding the point that a spectrographic 

are transferred to the main body of the copying machine 101 color measuring instrument 331 is connected to the com- 

and stored in the non-volatile RAM 322 in the main body of puter 321. Also in the block diagram shown in FIG. 27, the 

the copying machine 101. The calibration values for RGB image density adjustor 332 comprises a computer 321, a 

signals stored in the non-volatile RAM 322 are transferred 30 storage device 323, and the spectrographic color measuring 

to the CPU 130 just after power for the main body of the instrument 331. Further, in a case where a toner patdi 324i 

copying machine 101 is turned ON, and are stored in the prepared with toner is used as a color patch, a toner patch 

RAM 132 of the CPU 130. The cahl)ration value for RGB 324a is prepared with the main body of the copying machine 

signals stored in the RAM 132 of the CPU 130 are used in 101, so that the blocks as shown in FIG. 28 arc provided, 

execution of the ACC described above. 35 To describe a sequence for preparing calibration values 

The processing is executed as described below. for RGB signals with the configuration as described above 

with reference to the flowchart shown in FIG. 29, at first a 

AK'I^l-Kwl^hK'M (15) color patch is outpulted (step S7001). Then the YMCK color 

Au*¥ i^n/Y i-jifT n#n having a known spectral reflection characteristic is 

n^^tis^wisy^yQitgs] (16) ^ piaccd on the contact glass 118 of the document base of the 

^i^lsy^^4^iflsy^^{tJs] (it) *>ody of the copying machine 101 (step S7002). Then, 

with the color scanner 401 of the main body of the copying 

Herein t-w is a read value for white as a standard. It machine 101, the color patch is read to obtain read values for 
should be noted that the value may be for white of the RGB signals (step S70iDd). On the other band, in the corn- 
transfer paper 311, or may be an ideal white such as Av[t Js] 45 puter 321 which is an external computing device, read 
for an 8-bit signal if spectral reflection characteristic is values for the color patch from the main body of the oopjring 
known. machine 101 is down-loaded (step S7004), and tbe outputted 

In the example described above, tbe color patch 324 color patch outpuUed from the main body of the copying 

painted with ink or the like was used, but printcd-out a toner machine 101 is read with the spectrographic color measuring 

patch outputted from the main body of the copying machine 50 instruimcnt 331 (step S7005). 

101 may be used. Description is made for this case with Then, read values for RGB v0[tls] (t-W, Y, M, C, or 

reference to FIG. 24 and FIG. 25. FIG. 24 is a block diagram K:s»R, G, or B) when read with a CCD having a standard 

showing another example of seUing and inputting calibration spectral characteristic are computed from the read values 

values for RGB signals, and FIG. 25 is a flowchart showing v(ijs] (t-W, Y, M, C, or JC s-R, G, or B) for RGB of the 

a sequence for setting and inputting calibration values for 55 color patch down-loaded into the computer 321 as well as a 

RGB signals in FIG. 24. result of measurement of a spectral reflection factor through 

As shown in RG. 24, in this example, the configuration the expression (18), and a ratio k[t][s] (t-W, Y, M, C, or K: 

is the same as that shown in FIG. 21 excluding the point that s-R, G, or B) for each of RGB is obtained (step 7006). TTien 

a toner patch 324a is obtained (rom the main body of the the cah'bration values for RGB signals obtained from the 

copying machine 101, so that duplicated description is 60 computer 321 are up-loaded to the main body of the copying 

omitted herein. Also in the flow chart in FIG. 25 showing a machine 101 (step 7007) and are stored in the non- volatile 

sequence for preparation, the sequence from step S6002 to RAM 322 in the main body of the copying machine 101 

step S6007 is completely the same as a sequence from step (step 7008). 

S5001 to step 5006 in FIG. 22 excluding the step 6001 for Although the computer 321 is used as an external device 

placing the color patch 324 on the contact glass 118 of the 65 in the example described above, the processing through the 

basic body of the copying machine 101, so that also descrip- expression (17) may be executed by previously storing the 

tion of the steps is omitted herein. values for the expression (16) in the non- volatile RAM 322 
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or ROM 416 of the main body of the copying machine 101. Agli|ali|K0^n^255, i««0, i, . . . , lO t-Y, M. C. or K) 

Description is made below for the sequence in this case with Ab(tIa[iIK0$a^255, l-o, i, . . . , lO t-x M, c; or K) 
reference to the flowchart shown in FIG. 30. Namely, the 

YMCK gradation pattern (color patch) is placed on the and reference data Ar[t][n[i]] corresponding to n (n-1 to 20 

contact glass 118 of a document base of the main body of the 5 in the above case) other than n[i] (i«0, 1,2,..., 10) may 

copying machine 101 (step S8001), and the color patch is be computed by interpolation as described below. As one of 

read with the color scanner 401 of the main body of the the examples, the value may be computed by means of 

copying machine 101 to obtain read values for RGB signals interpolation using reference data Ar, g, b[t][n[i]], Ar, g, 

(step 8002). Then read value y[ijs] (t-W. Y, M, C, or K: b[tln[i+l]] corresponding to n[i]^n^n[i+l] (for n-1 to 20, 

s»R, G, or B) for RGB of the color patch are compared to lO i«0, n[0]«=0, n[l>-21). 

the read value v0[tls] (t=W. Y, M, C or K: S=R, G, or B) for On the other hand, in a RAM 417, percentages of RGB 

RGB when read with a CCD having a standard spectral components in the reference data for read values for the 

characteristic and previously stored therein, and a ration patterns are stored as indicated by the expression (10). 

k[tls] (toW, Y, M, C, or K: s-R, G, or B) for each is K[slt] in the expression (10) takes a value close to 1. 

obtained (step 8003). Then the calibration values for RGB 15 However, as indicated by the Expression 9, inside a copying 

signals obtained as described above are stored in the non- machine, the value is stored as integral number data. A value 

volatile RAM 322 in the main body of the copying machine of k[slt] obtained as described above which is a calibration 

101 (step 8004). value for the RGB signals is like that as shown in Table 1 

It should be noted that, in a case where a printer controller above, 

is connected to use the image forming apparatus as a printer, 20 The calibration data for the RGB signals shown in Table 

when outputting data from the host computer connected to 1 is, as shown in FIG. 19, displayed on a dii^lay screen 305 

the printer controller, or by preparing a command for setting of an operating section of the main body of the copying 

the calibration values in a printer set command, the calibra- machine 101, and the numerical values can be inputted by 

tion values for RGB may be set. Also in a case where a pressing a section corre^nding to a section to be displayed 

memory card can be used, the calibration values may be 25 with a finger. The inputted data is stored in the RAM 417. 

stored in the memory card so that the calibration values can As one of the examples, description is made below for a 

be read out when the image forming apparatus is used. case of t"C (cyan). GOB components of the reference data 

In the first embodiment described above, an imag? signal for cyan toner are calibrated as follows: 

convcraon table is prepared and selected according to read Awr^ri«rnwrfw^rfCT«rniMrfwTbcJtfr¥ci 

values read for a gradation pattern, but also an imagp signal 30 AHia«[aMKWKt'(CI/i[«TM4WI)x*(rlc] 

conversion table is prepared and selected according to read As4CIi<iTMrf'n<^M<^'<*IMsl»T)x*MCJ 

signals read for gradation patterns formed on a transfer AMCI^»IMM»iWMcW.I}-AMWDxlCfrlc] (2i) 

member as well as to reference data (gradation target data) 

corresponding to read signals for gradation patterns stored in It should be noted that i>^, 1, 2, . . . , 10 in the egression 

a storing means. Description is made for the embodiment 35 (21) above. Herein (Arl[CIn[i], Agl[CIn[il, Abl[CIii[iI) 

below. It should be not&d that, in the second embodiment, indicates RGB components in reference data after 

the same reference numerals are assigned to sections corre- calibration, and (Ar[CIn[i]], Ag[CIn[i]], Ab[CIn[i]] indi- 

sponding to those in the first embodiment, and description cates reference data before calibration. Also Ar[W], Ag[W], 

thereof is omitted herein. . and Ab[W] are RGB signals when a while - color (the 

The reference data consists of input values n into a 40 brightest color to the scarmer 401 to be used) is read 

gradation conversion table (n»0, 1, 2, ... , 255) and target respectively. In a case where a red value is an 8-bit signal, 

values for vahies read by a scanner 401 (rftji], g[tli], this value is in a range from 0 to 25, and vahie 0 indicates 

b[tli]), and the reference data is expressed as follows: the darkest image density, namely a quantity of light 

detected by a CCD in the scanner 401 when an object with 

AiftlnKOS 0^255, t-Y, M, c, or K) 45 a low reflection factor or a low transmission factor is read, 

VA*- ^^cc . V ^ aod value 255 indicates the brightest image density, namely 

Ag[tInK0^D^255, t-Y, M, Q or K) . r i- j . j ^^-^ . ^ 

^ * ^ ^ quantity of hght detected by a CCD m the scanner 401 

Ab(tInKOs 0^255, t-Y, M, Q or K) (19) when an object with a high reflection factor or a high 

transmission factor is read. 

Herein Ar, Ag, and Ab are reference data for a red signal, so h should be noted that each value may be set as follows 
a green signal, and a blue signal respectively, while YMCK in practical operation, although the precision becomes some- 
indicates a color of toner. what lower 

The above expression (19) indicates that a probable input 

value into a gradation conversion tabic, namely reference Ai(w>-Ar(ClO] 

data corresponding to any of 256 values from 0 to 255 arc 55 Ag[w}-Ag[ciO] 
stored on a memory with the processing for 8-bit signal. By 

storing reference data consisting of 256 values as described ^ * ^ 

above, the processing described later can be simplified, but Herein, Ar(C][0], Ag[C][0], and Ab[C][0] are values 

to save a memory space required for storing the reference obtained when the background color section of the paper is 
data, by storing the following set with the reference data so read. It should be noted that, when reading a background 
obtained through the expression (19) and corresponding to color section of paper, it is possible to prevent the precision 

several value of n[i] (in this case, 16 types of value) with from becoming lower by setting several sheets of white 

n[0>'0, n[i}=26xi-5 (i=l, 2, . . , , 10) as an example thereof: paper to make up so-called the white back so that the 

backing for the paper will not become dark. 

nlil(osnS255, iM), 1 10) ^ another example, in a case of t=C (cyan), practically 

Ai{tIn[ilX0Sn5255, i-0, 1 10 t-Y. M, C, or K) processing can be executed by setting each value as 

follows: 



25 

Arl[C\ [n[t\]^Ar[W]^iAr[C\ [n[t\]xk[r] [C\ 
Agm ln[i\] = Ag[W\ + (Ag[C] [nm xJk[^] [Q 
Ab\[C] [n{i]]=Ab[W]^{Ab[C] [n[i\] - Ab[W\)xk[b] [C\ 



Herein, i io the expressioa (22) is in a. range from 0 to 10. 
However, in a case of n[0], namely in a case where an 
input value into the gradation conversion table is 0 (zero), lo 
calibration by the expression (22) should not be performed. 
The values of k[rIC], k[g][C], and kOJC] used in the 
expression (22) are not equal to the values of k[rJC], 
k[gIC], and k[bIC] used in the expression (21) , and it is 
necessary to change the numerical values to appropriate is 
ones for each expression. To simplify the processing, the 
(Ar[C][n[iI|, Agl[CIn[iI|. AblIC][n[i]D ^ modified lo (Ar 
DI°[i]]> Ag[t][n[i]], Ab[tln[i]]) and is used in the process- 
ing described below. 

Next, description is made for a sequence for producing a 20 
gradation conversion table (LUT) executed during execution 
of ACC in a y-calibrating circuit 410 which is a Y-conversion 
processing section. 

Image signals for complementary colois for YMC toners 
are blue, green, and red respectively, and to simplify the 25 
processing, of the reference data Ai[t][i], Ag[tXi], and 
Ab[tli], the reference dataAb[tIi], Agftfi], and Ai[tli] for 
complementary colors for the toners are used. This treatment 
is effective in a case where the spectral (reflection) charac- 
teristic of used toner does not change largely, namely in a 30 
case where the color taste does not change. Herein to 
simplify the description, the following expression is used: 

A[tIn[ilK0Sn[i]S255, £-0, 1. ... , 10; ihC, M, Y) 

For blade toner, adequate preciseness is obtained by using 35 
either one of the RGB image signals, but therein the G 
(green) component is used. 

Similarly, also the read signal is expressed using only an 
image signal for the complementary -color as follows: 

40 

a{tIi)Ci-0, 1, . . . . 9; tiC, M. Y, K) 

Furthermore reference data A[tli] for toner I for a certain 
color (t**C, M, Y, K) and a written value for a laser 
beam (LD) are expressed as A[i] and a[t[i] in abbreviated 
forms respectively. 45 

Next description is made for a computing sequence with 
reference to FIG. 31. FIG. 31 is a flowchart showing a 
sequence for preparing a gradation conversion table in 
execution of ACC. 

At first, an input value required for preparation of a 50 
YMCK Y-calibration table is computed (step S3001). Herein 
it is assumed that n[i]»ll[h]xi (i««=0, 1, . . . , imax-15). Then, 
the reference data A[n] is calibrated with a calibration value 
k[s[t] for RGB signal according to the sequence described 
above (step S3002). Then the reference data A[n] is cali- 55 
brated according to an image density which can be out putted 
from the printer 412 (step 3002^i). Herein, it is assumed that 
a read value for a laser bean which makes it possible to 
obtain the maximum image density obtainable with the 
printer 412 is FFh (displayed in a form of hexadecimal 60 
form), and also that the read value m [FFh] for the pattern 
then is mmax. Also it is assumed that reference data not 
calibrated in a range from the low image density to the 
intermediate image density is A[i] (i=0, 1, . . . , il); reference 
data not calibrated in the high image density side is A[i] 65 
(i=i2+l, . . . , imax-1) (i2^il, i2^imax-10, and reference 
data to be cabl>rated in the area is A[iXi"il+l, . . . , i2). 
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Next description is made for a concrete computing 
(22) method assuming an image signal not subjected to RGB 
Y-conversion which is proportional to a reflection factor of 
the document. Of the reference data not subjected to 
5 calibration, the difference Aref is computed from the refer- 
ence data A[i2'f 1] with the lowest image density in the high 
image density section as well as fiom the reference data 
A[il] with the lowest image density in the low image density 
section. 

Namely, the following expression is applicable: 



(23) 



On the other hand, in a case of reflection factor linear or 
a brightness linear not requiring RGB y-conveision which is 
a process for inversion, the Aref is larger than 0. Also the 
different Adet is computed from the read value mmax for the 
pattern with the maximimi image density obtainable with the 
printer 412. Namely the following expression is applicable: 



Sdet'^ [il]-miTiax 



(24) 



From the expressions (14) and (15) above, the reference 
data A[i] (i»il+l, . . . , i2) having been subjected to 
calibration of the high density section is: 

A[i3^[a}+^{i}-Alil>(Aife//An:/) (i-a, il+2, . . . , t2-l, O) (25) 

Then an image signal n[i] read by the scaimer 401 
corre^x)Dding to n[i] obtained in step 3001 is obtained Crom 
the reference data A[n] (step 3003). Actually, the reference 
data A (nQ] (O^nQ] 255, j-0, 1, . . . , jmax. n[j]^n[k] for 
i^k) corresponding to discrete nQ] is set as follows. Namely, 
j (O^j^jmax) for n[j]^n[i]<n[j+l] is obtained. 

In a case of an R-bit image signal, by obtaining reference 
data assuming that n[0]-0, n[imax]-255, nOmax+lJ-n 
[jmax]+l, and A[jmax+1]-A[jmax], the computing is sim- 
plified. 

Also , the smaller the gap n[j] in the reference data is, the 
higher a degree of preciseness of the finally obtained 
y-calibration is. 

A target value m[i] is obtained from j obtained as 
described above through the following expression: 



m(<>AD>*[/H*D+iM[i'I)(«('>'»[/"IVC'<''+iM<T) 



(26) 



Herein, interpolation is performed with a linear 
expression, but interpolation may be formed with a high- 
order function or a spline function. In that case, 

Ako in a case of a the k-th function, the Expression 17 
described above may be used. 

Then a written value LD[i] for LD to obtain the taiget 
value m[i] obtained in step S3003 is obtained through a 
sequence similar to that in step 3003 (step 3004). 

Namely, when image signal data not having been sub- 
jected to RGB y-conversion is processed, as a value of LD 
becomes larger, a value of a [LD] becomes smaller. In other 
words, in contrast to 

L£l{k}<LD{k+\) 

the following expression is applicable: 

Herein an LD value when a pattern is formed can take 10 
values of LD [k]=00h, Uh, 22h, . . . , 66h, 88h, AAh. FFh. 
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{k«0, 1, .... 9). This type of setting is employed because, 
as values for a quantity of deposited toner read by the 
scaooer 401 largely changes in an area with image density 
corresponding to a small quantity of deposited toner, gap 
between written value LD[k] for a pattern is made smaller to 
read the area, and also as values for a quantity of deposited 
toner read by the scanner 401 little changes in an area with 
image density corresponding to a large quantity of deposited 
area, the gap be made larger to read the area. 

The merits provided by forming a pattern with LD read 
values as described above are that, as compared to a case 
where the number of patterns is increased as indicated by 
LD[k]»00h, lib, 22h, . , . , EEh, FFh (16 patterns in total), 
a consumption rate of toner can be suppressed, and that LD 
written values Uttle change in a high image density area, and 
the scheme as described above is employed because, as read 
values easily changes due to non-uniformity in potential on 
a photosensitive body, non-uniformity in deposition of toner, 
and also non-uniformity in potential on toner, making 
smaller a gap between LD written values is not always 
effective for improve the preciseness. 

Herein to LD [k] satisfying the following expression: 

the following expression is applied: 

ID[i>^i:}t<LD[*+lJ-i^tI)-Hi>4Zi)(tIiy(aZJX*+lM^ 

In a case of O^k^kmax (kmax>0), if a[LD[kmax]] is 
larger than m[i] (if image density for a target value obtained 
from the reference data is high), the following expression is 
used: 

LD[f>^iHU)[jbnax^iJ3(Jbiux-ll)-</n[fl^ 
(aZi)[iiiux)-4^Z7(Anuai-llD 

and estimation is made by performing by extrapolation with 
a linear function. In addition to use of a linear function, other 
methods such as use of logarithm may be employed for 
extrapolation. 

With this a set (n[i], LD[i]) (i-0, 1, . . . , 15) of an input 
value o[i] into a YMCK y-calibration table aixi an output 
value LD[i] can be obtained. 

And according to the obtained (n[i], LD[i]) (i-0, 1, . . . , 
15) interpolation is performed with a spline function or the 
like, or a y-calibration table in the ROM 416 is selected (step 
3005). 

Sections, operations and processes not specifically 
described herein are the same as those in the first embodi- 
ment. 

As understood from the description above, with an image 
forming apparatus according to the present invention, it is 
possible to correct spectral sensitivity of an image reading 
means varying unit by unit and to obtain a gradation 
calibration table for obtaining good gradations. Also it is 
possible to prepare a YMCX. gradation calibration table for 
obtaining good color balance in a color image forming 
apparatus. 

With an image forming apparatus according to the present 
invention, in a case where ^ctral (transmission) charac- 
teristics changes due to change of an image reading means 
during passage of time, or even in a case where spectral 
(transmission) characteristic of toner being used changes, it 
is possible to always obtain a correct value by setting a ratio 
between a plurality of signal read values each having 
different spectral sensitivity. 

With an image forming apparatus according to the present 
invention; a service man or a user can easily obtain a desired 
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image by freely changing a calibration value previously set 
in an operating section of an image forming apparatus. 

With an image forming apparatus according to the present 
invention, when non-uniformity of spectral sensitivity of an 

5 image forming means which will vary from unit to unit can 
be calibrated in the assembly step by inputting a value for 
calibration fiom the device provided outside the image 
forming apparatus, and with this feature a calibration value 
can easily be set in each image forming apparatus. 

10 With an image forming apparatus according to the present 
invention, even in a case where characteristics of a machine 
changes during passage of time or a color characteristic of 
toner changes, an appropriate value can easily be set as a 
calibration value according to the change, and a serviceman 

15 or a user can set an appropriate cah*bration value with simple 
operations. 

With an image forming apparatus according to the present 
invention, it is possible to correct spectral sensitivity of an 
image reading means which varies unit by unit and also to 

20 prepare a YMCK gradation calibration table for obtaining 
good color balance and gradations by executing ACC. 

With an image forming apparatus according to the present 
invention, in a case where ^>ectral (transmission) charac- 
teristic of an image reading means changes during passage 

25 of time, or in a case where spectral (reflection) characteristic 
of toner being used changes, a ratio between RGB read 
values for YMCK toner being used for the image reading 
means can be ii^utted according to the necessity, and a read 
value for YMCK toner can always be calibrated to an 

30 appropriate value. 

With an image forming apparatus according to the present 
invention, a serviceman or a user can input an a^ropriate 
calibration value into an operating section of an image 
forming apparatus, so that a gradation calibration table for 

35 obtaining good color balance and gradations can be obtained 
by executing ACC. 

With an image forming apparatus according to the present 
invention, data for calibrating non-uniformity in spectral 
sensitivity of an image reading means which varies for each 

40 image forming apparatus can be prepared or set with a 
device provided outside the image forming apparatus in the 
assembly step, so that data can rapidly be set in the image 
forming apparatus, 
^th an image forming apparatus according to the present 

45 invention, even if machine characteristic changes during 
passage of time or color characteristic of toner changes, it is 
possible to have an appropriate value stored as a calibration 
value according to the change, and a gradation calibration 
table for obtaining good color balance and gradations can be 

50 obtained by executing ACC. 

This application is based on Japanese patent application 
Nos. HEI 8-296542, HEI 8-116723 and HEI 9-109257 filed 
in the Japanese Patent Office on Nov. 8, 1996, May 10, 1996 
and Apr. 25, 1997, re^ctively, the entire contents of whidi 

55 are hereby incorporated by reference. 

Although the invention has been described with respect to 
a specific embodiment for a complete and clear disclosure, 
the appended claims are not to be thus limited but are to be 
construed as embodying all modifications and alternative 

50 constructions that may occur to one skilled in the art which 
fairly fall within the basic teaching herein set forth. 
What is claimed is: 

1. An image forming apparatus comprising: 
a reading means for optically scanning and reading a 
65 document image; 

a means for converting an input image signal from said 
reading means to an output image signal by referring an 
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image signal conveisioD table, and oulpulting tbe con- 
verted signal; 

a writing means for writing image information on an 
image carrier according to said output image signal; 

a means for transfer the image on said image carrier onto 
a transfer member to form the image; 

a means for generating a plurality of gradation patterns; 
and 

a means for updating and selecting an image signal 
conversion table according to read values obtained by 
reading the gradation patterns generated and trans- 
ferred by said generating means onto transfer paper 
with said reading means for reading an image; wherein 
a read signal for said gradation patterns comprises a 
plurality of signals each having different spectral 
sensitivity, and a memory for storing therein calibration 
factors for said plurality of signals each having differ- 
ent spectral sensitivity is provided to correct the read 
signals for said gradation patterns according to said 
calibration factor from said memory. 

2. An image forming apparatus according to claim 1 
further comprising a means for setting a ratio between read 
values for said plurality of signals each having different 
spectral sensitivity. 

3. An image forming apparatus according to claim 2; 
wherein said means for setting a ratio between read values 
sets the ratio between read values from read values for said 
patterns as well as from read values for a plurality of signals 
previously stored therein. 

4. An image forming apparatus according to claim 2; 
wherein setting by said means for setting a ratio between 
read vahies is performed by inputting data from an operating 
section of the image forming apparatus. 

5. An imagp forming apparatus according to claim 4; 
wherein said means for setting a ratio between read values 
sets the ratio between read values from read vahies for said 
patterns as well as from read values for a plurality of signals 
previously stored therein. 

6. An Lmag^ forming apparatus according to claim 2; 
wherein said means for setting a ratio between said read 
values is provided outside the image forming apparatus and 
inputs said ratio between read values into said image form- 
ing apparatus from the outside thereof. 

7. An image forming apparatus according to claim 6; 
wherein said means for setting a ratio between read values 
sets the ratio between read values from read values for said 
patterns as well as from read values for a plurality of signals 
previously stored therein. 
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8. An image forming apparatus comprising: 

a means for optically scanning and reading a document 
image; 

a means for converting an input image signal from said 
reading means to an output image signal by referring to 
an image signal conversion table and outputting the 
converted signal; 

a writing means for writing image information onto an 
image carrier according to said output image signal; 

a means for transferring the image on said image carrier 
onto a transfer member to form the image; 

a means for generating a pliu-ality of gradation patterns; 
and 

a means for updating and selecting an image signal 
conversion table according to read signals for gradation 
patterns generated and formed on a transfer member by 
said generating means and read by said image reading 
means as well as to reference data which is gradation 
target data corresponding to the read signals for said 
gradation patterns stored in the storing means; wherein 
said reference data comprises a plurality of signals each 
having different spectral sensitivity, and said image 
forming apparatus has a memory for storing calibration 
factors for the plurality of signals each having different 
spectral sensitivity and a means for calibrating said 
reference data according to said calibration factors. 

9. An image forming apparatus according to claim 8 
further comprising a means for setting a ratio between said 
reference data having different ^ctral sensitivity respec- 
tively. 

10. An image forming apparatus according to claim 9; 
wherein setting by said means for setting a ratio between 
reference data having ^ctral sensitivity is performed by 
inputting data from an operating section of the image 
forming apparatus. 

11. An image forming apparatus according to claim 9; 
wherein said means for setting a ratio between reference 
data having different spectral sensitivity is provided outside 
the image forming apparatus and the reference data from 
said setting means is inputted into said image forming 
apparatus. 

12. An image forming apparatus according claim 9; 
v^erein said means for setting a ratio between reference 
data having different spectral sensitivity sets a ratio between 
read values from read values for said patterns as well as from 
read values for a plurality of signals previously stored 
therein. 
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ABSTRACT 



A solid-state image pickup apparatus for generating image 
piciaip signals prodiuxd by a solid-state image sensor. The 
image sensor is driven at a data rate of f,i with a predeter- 
mined phase. Digital luminance signal Y aiul two digital 
chrominance signals Cj^ C^ are generated by a first digital 
processing unit, operated at a clock rqte rd^ied to the data 
rate of f^i, from the digitized image pickup signals. These 
signals are then converted by a seccmd digital processing 
unit into signals Y, Cj^ and C^ having a data rate related to 
f^ The second digital processing unit performs bandwidth 
limitations on these signals by a half band filter having a 
passbaixl f^ f^ and f^ and peilbrms data rate conver- 
sion of from 2f,it0 f^ firom f,i to f^ or f^4 and from f,, 
to 0€ f^4, for outpotting the low order linear phase 
finite impulse response sufSdent to suppress high-order 
sideband components in the vicinity of n-2f,i, n f^j, and 
n f,„ (n being a positive integer) in a form that can be 
down-sampled at f^ f^ or f^4 and f^ f^4. The 
' second digital processing unit can have a simplified con- 
struction when the characteristics of the half band filter are 
used to compensate fOT the band pass rollover diaracteristics 
of the late-convening filter. 
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SOLID STATE IMAGE PICK-UP APPARATUS 

FOR CONVERTING THE DATA CLOCK 
RATE OF THE GENERATED PICTURE DATA 
SIGNALS 

This application is a ccmtinuation of application Ser. No. 
08/133^, filed Oct 8, 1993, now abandoned. 

BACKGROUND OF THE INVENTION 

1. Held of the Invention 

This invention lelates to a sol id-state image pickup 
qiparatus for prodndng digitized picture data firom image 
pickup signals produced by a solid-state image sensor such 
as a CCD image sensor iiiade 1^ of cfaaigecoupled devices 15 
(CCDs) and outpotting the produced digitized picture data. 
More particolariy, it rdates to a solid-state image pidmp 
^iparatus having a rate converting function of converting 
the data dodc rates of the generated picture data. 

Z Description of the Prior Ait 20 

It is known in general that, in a solid-state image pidaip 
^qiaratus having, as image pickup means, a solid-state 
image sensor having a discrete pixd structure, such as a 
CCD image sensor, since tbe solid-state image senscv itself 
is a sampling system, aliasing compoiwots firom the spatial ^ 
sanqrfing ftespxocy tend to be "pxf^ into the image pidoip 
sigmil &om die solid-state image sensor Tbe ooDvcntional 
practice for pseventing the generation of «lia<^g compo- 
nents into the basd)and component of the image pickup 
signals is to provide a double refiracdon type optical low- 30 
pass filter in the image pickup optical system to suppress 
Mgh-frequeacy conqxments of the basdnind component of 
the image pickup sig^ials to satisfy the Nyquist concfitio^ 
the sampling system constituted by the sdid-state image . 
sensor. 35 

On the other hand, with a color television camera device 
f(R- imaging a color picture, a multiple CCD plate type. 
sc^id-stMe image pickup apparatus, such as a two CCD plate 
type soMd-state image pidoip apparatus, for imflgtng a 
three^Ior picture by a solid-state image sensor having for ^ 
imaging a green-cdored picture and a solid-state image 
sensor having a color codmg filter for led-colored and 
blue-colored pictures, or a three CCD plate type solid-state 
iinagB pidoip sq^[>aratu8 for imaging a three-color picture by 
sqiarate solid-state image sensors, has been put to practical 
use. 

Besides, as a technique for inqsroving the resolution in the 
above-described mnlt^le CCD plate type solid-state image 
pickup qjparatus, there is known a ^>atial pixd shifting ^ 
method in which the solid-state image sensors for imaging 
red-colored pictures and blue-colored pictures are shifted 
with respect to the solid-state image sensor for imaging the 
red-coicnred picture by one-half the spatial pixel sampling 
period. By adopting the spatial pixd shifting method, a high ^ 
resolution exceeding the threshold of the number of pixels of 
the sc^d-state image sensor may be realized with the mul- 
tiple CCD plaie type solid-state image pidoip apparatus with 
an analog output 

On die other hand, a D-1 standard or a D-2 standard is ^ 
prescribed as the standard foe an industrial digital VTR 
employed in e.g. a telecasting statioa Thus a digital inter- 
face for a digital video related equipment c uufo iii ii ng to 
these standards has become necessary to provide foft a color 
tdevision apparatus. ^ 

It is noted that with the D-1 standard for 4:2:2 digital 
component video signals, the sampling finequency is set to 



13.5 MHz, corresponding to 858 times the horizimtel fre- 
^o^cy f^tNTsc) ^ NTSC. system and to 864 times the '• 
hoiizcnital frequency f^^i^iML) ^ system, and is 
adapted for being locked at a frequency equal to an integp- 
number times the horizontal frequency for either systems. 
On the other hand, with the D-2 standard for the digital 
composite video signals, the sampling frequency is set to 
four times the subcarrier frequency to nrim'mize beat inter- 
ference between the subcarrier and sampling docks, with the 
sampling frequency fspmo ^ NTSC system and the 
sampling frequency for the PAL system fj^AU} ^xing 143 
MHz and 17 J34 NfHz, respectivdy. 

Meanwhile, if it is desired to iiiq)lenient a solid-state 
image pickup ^iparatus capable of direcdy outputtmg digital 
picture sifnals conforming to the above-mentioned D-1 and 
D-2 standards, such digital picture signals being trigh in 
resoluticm and picture quality and containing mdy little 
aliasing distortion components, it is necessary that the 
sanipling rate (number of pixels) of the solid-state image 
sensor employed in the image pidmp unit be set so as to be 
higher than the sampling rate for tbe D-1 or 1X2 standard, in 
consideration that the optical low-pass filter as aprefilter for 
the sdid-state linage sensctf is opticaBy not unobjectionable, 
that is that only smoc^ roU-off characteristics m^ be 
obtained with the optical low-pass filter such that high 
modulation transfer function (MTF) characteristics may be 
obtained only at tbe costs of increase in the aliasing distor- 
tion components. 

Besides, if account is taken of the fact that correction of 
pixd-based defects in the image pickup signals by the 
solid-state image sensor is j > «ri iii»flri by a digital technique, 
and die beat iiteference has to be pr e v aile d firom occurring, 
it is desirable that the sampling rate of the soUd-state image 
sensor be coincident with that of the analog-tcMligital con- 
verting mtit ad^Jted for digitizing the image pickup signals 
supplied by tbe solid-state image sensor. 

The CCD image sensor now in widespread use is driven 
at the dock rate of 143 MHz^^ciwtso- & digital 
camera having its image pidoip umt constituted by sudi 
CCD image sensor, image pickup signals outputled from tbe 
solid-state image sensor are digitized at the above-men- 
tioned dock rate of 143 MHz:^^^^;^,,^ by way of per- 
fbmiing a digital signal processing opoBdatL 

However, the dock rate in the D-1 standard, which is the 
standard for the above-mentioned 4:2:2 digital corx^xment 
video signals, cannot be matrhfri to the clock rate for the 
above-mentiotiBd digital camera having its image pickup 
unit constituted by such CCD image sensor, with the lumi- 
nance signal Y and die color difference signals Cj/Cg for the 
D-1 standard being 13.5 MHz and 6.75 MHz, respectivdy. 
If a CCD image sensor having the readout rate of 13.5 MHz 
is to be febricated newly for meeting the D-1 standard, there 
is raised a problem in connection with costs and limitation 
in general adaptability. 

On die other hand, with die multiple CCD plate type 
solid-state image pickup qyparatus, cmistructed in accOT- 
dance with the spatial pixel shifting method, the analog 
output cannot be inqiroved in resolution unless a signal 
processing system operated at a dode rate of 2f^i, which is 
double die clock rate f^| of the CCD image sensor, is 
employed. AlUiough it may be contemplated to process 
signals at f^j and 2f^j and to turn the signals into analog 
signals at f^i and 2f,i, with the analog signals being then 
passed through an analog filter so as to be digitized again at 
die dock rate prescribed by die D-1 standard. However, in 
such case, beat interference is produced between the 143 
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MHz system and the 1 3 J MHz system to incur deteriorattoii 
picture quality. 

OBJECTS OF THE INVENTION 

5 

In view of the above-depicted status of the art, it is an 
object of the present invention to provide a solid-stale image 
pi(±up apparatus wherein digital picture signals with the 
dock rate of the D-1 standard or otter clock rates may be 
obtained using a staodaid CCD image sensor. lo 

It is another object of the present invention to provide a 
solid-slate image pickup apparatus wherein hig}) picture 
quality digital picture signals fnce of beat interference may 
be produced with the aid of a signal processing system 
operated at the same dock rate as the dock rate for the CCD 13 
image sensor. 

It is a further object of the present inventioD to provide a 
solid-state image pickup a p pgratiiR wherein the digital pic- 
ture signal with a high modulation transfier function (MTF) 
may be obtained with the use of the spatial pixel shifting ^ 
method. 

ft is yet another object of the present inventicm to provide 
a solid-state image pidoip sypparatus which is simplified in 
construction by sinq)lifying the construction of digital pro- ^ 
CFiXiting means performing a rate converting operation, 

SUMMARY OF THE INVENTION 

In view of the above objects, the present invention pro- 
vides a solid-state image pidmp qyparatus conqirising at ^ 
least one solid-state image sensor driven at a rate f,„ an 
analog-to-digital converting unit for digitizing picture sig- 
nals outputted from the solid-state image sensra: at the rate 
f,i of a predetermined phase, a first digital processing unit 
for genoating at least a digital hnninanoe signal Y and two 
digital color difference signals Cj^ and C^ from the picture 
data digitired by die analog to digital converting unit, and a 
second digital processing unit for converting the input data 
rate signals Y, Cjt and C^ related to the above rate f,i 
generated by the first digital procesang unit into signals Y, ^ 
Ca and Ca having the ou^wt data rate related to the above 
rate f„ . The second digital processing unit comprises a half 
band filter having a passband of f^^ f^4, f^4 for per- 
fonning bandwidth limitation on the inpai data rate signals 
Y, Cj, and C^ generated by the first digital processing unit, 
at the output data rates of 2f,i, f,,, f^i, and a rate converting 
filter for perfonning rate conversion of firom 2f^i to f^, from 
f,, to fg/l or f^4, from f,, to f^ or f^4, for outputting 
the low order linear phase finite impulse response sufSdent 
to suiqxress high-order sideband components in the vicinity ^ 
of nxZf^j, tixf^i, nxf^,, n being a positive integer; in a fonn 
that can be down-sampled at f^ f^ OT f^4, f^ or f^4, 
with the half band filter having characteristics of compen- 
sating bandpass roll-off characteristics of the rate converting 
filter. 

With the solid-state image pickup apparatus according to 
the present invention, the rate converting filter has at least 
one zero pdnt at nx2f,|, nxf^„ nxf^j and each two zero 
points in the vicinity diereof. ^ 

With the solid-state image pickup qiparatus according to 
the present invention, the rate converting filter is constituted 
fay a plurality of mult^liers. 

^th the solid-state image pickup apparatus according to 
the present invention, the half band filter comprises a 6S 
product of partial filters each constituted by integer coeffi- 
cients. 
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The present invention also provides a solid-state image 
pickup 2^paratus comprising a plurality of solid-state image 
sensors arranged in a color-separating system in aocordanoe 
with the spatial pixel shifting method so as to be driven at 
a predetermined rate of f,i, analog-to-digital converting 
means coupled to the image sensors for digitizing the image 
signals at a rate of f,i. first digital processing means supplied 
with the image sigiials digitized by the analog-to-digital 
converting means for providing at least a digital luminance 
signal Y (2f,i) having a rate equal xd 2f,, and two digital 
color difference signaU Cj, (f,i) and Cg (f,i) each having a 
rate equal to f^i, second digital pnx^ssing means coupled to 
the first digital processing means for converting the data rate 
of the input data rate signals Y (2f,i), (f,,), C^ (f,i) from 
m to n, m and n being natural numbers, for providing a 
digital hmunance signal Y(f^ having a rate equal to f^ 
2f,j-n/m and two color difference signals C^ (f^ and C^ 
(f^ having a rate substantiany equal to f^ 

The second digital processing unit in the solid-state image 
pickup apparatus according to the present invention com- 
prises a half band filter having a passband of f^, f^ and 
f^ for the input data rate signals Y (2f , , ), Cj, (f, , ) and C^ 
(f,i) , respectivdy, generated by the first digital processing 
unit at output data rates of 2f,i, f,i and f,„ respectivdy, and 
a rate converting filter for performing suppression of high- 
order side-band components in the vicinity of nx2f^i, nxf^^ 
and nxf,„ respectivdy, on signals Y (2f,,). C, (f,,) and Cg 
(fji) suppHed via the half band filter in the ^wxt-sampled 
form of f^ f^ and f^j/i respectivdy, n bdng a namral 

Tlie solid-state image pickup device di^tizes image 
pidoip (picture) signals outputted firom at least a solid-state 
image sensor driven at a rate f^^, at a rate f,i widi a 
predetermined phase by a [ffedetermined analog-to-digital 
converting unit to form digital image pidoip data, generates 
a digital hmnnance signal Y and two dighal chrominance 
signals Cj^ C^ from the digital image pickup data by a first 
digital processing unit operated at a clock rate tdated to the 
rate f,„ and converts die signals Y, and C^ having an 
iiqnit data rate rdated to the f,i rate into signals Y, C^ and 
C^ having an output data rate related to the ^ rate by a 
second digital processing uniL Hie second digital processng 
unit performs bandwidth limitaticm on the input data rate 
sign^ Y, CjK and C|^ generated by the first signal processor, 
at output data rates of 2f,i, f,, and f^j, by a half band filter 
having a passband of f^4 and f^4, respectivdy, and 
performs rate conversion of finom 2f^, to f^ firom f^i to f^/l 
or f^4, ftom f,i to f^ or f^4, for aitputting the low order 
linear phase finite impulse response suffidem to suppress 
high-order sideband components in the vicinity of nx2f^i, 
nxf,i, nxfjt, n being a positive integer, in a fonn that can be 
down-sampled at f^ f^ or f^4. f^ or f^4, respec- 
tivdy. Besides, the baiidpass roll-off characteristics of the 
rate converting filter may be compensated by the character- 
istics of the half band filter. 

With the solid-state image pickup apparatus according to 
the present invention, the sigr^ limited in bandwidth by the 
half band filter is rate-converted by a rate converting filter 
having an integer coefficient impulse response having at 
least one zero point at nX2f^i, nxf,, and n>df,i and each two 
zero points in the vicinity thereof. 

Wiih the solid-state image pickup apparatus according to 
the present invention, the signals limited in bandwidth by the 
half band filter are rate-converted by a rate amverting filter. 

Mth the solid-state image pickup apparatus according to 
the present invention, the input data rate signals Y, Cj^ and 
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Cg genoated by the first digital piocessiog unit, are Undted 
in bandwidth by a half band filter comprising a pnxfaict of 
partial filters each constituted by integer coefficients. 

Besides, with the solid-state image pickup apparatus 
according to the present invention, output image pickup ^ 
signals of phiral solid-state image sensors arranged in the 
color-separation optical system in accordance with the spa- 
tial pixel shifting method so as to be driven at the rate f,i are 
digitized by the analog-to-digital converting unit at the rate 
f,i having a predetermined phase, at least a 2f,] rate digital 
luminance signals Y (2f,i) and two f,, rate digital color 
difference signals Cj^ (f^J and (f,|) are generated by the 
first digital processing unit from the ^gitized image pickup 
data and rate-converted by the second digital processing unit 
from m to n, m and n being positive integers, for generating 
digital luminance signals Y (f^ having the rate of f^ 
f,i-n^ and digital color difoeiice signals (f^ and 
(f jiz) having substantially the data rate of f^/L 

On the other hand, with the solid-state image pickup 
apparatus according to the present invention, the second ^ 
digital processing unit p er f or m s bandwidth limitation on the 
xrqyut rate signals Y (2f,i), Cj^ (f,j) and generated by 

the first digital processing unit at tbe ou^Mt rates of 2f,i, f,| 
and f,i, by a half band filter having a passband of f,^ f^4 
aiidf^4, respectively, and generates digital color diffoence ^ 
sign^ (f^, (f^ Cb having substantially die rate of 

BRIEF DESaaTTTON OF THE DRAWINGS 30 

FIG. 1 is a block diagram showing an arrangement of a 
digital cam carder embodying the present inventioiL 

FIG. 2 is a block diagram showing an illustrative example 
of a signal processing section for an analog output in the as 
digital cam covder shown in FIG. L 

FIG. 3 is a block d ia gr am showiiig another iOustrative 
example of a signal processing section for an analog output 
in the digital cam cotder shown in FIG, 1. 

FIG. 4 is a Mock diagram showing an illustrative example ^ 
of a rate converting circait for luminal^ signals in the 
digital cam cocder shown m FIG. L 

FIG. 5 is ablock diagram showing the state of co nn ection 
for a recording mode of die rate converting circuit for 
luminance signals. 

FIG. 6 is a block diagram showing the state of connection 
for a playbadc mode of the rate converting circuit for 
lundnanoe signals. 

FIG. 7 is a block diagram showing an illustrative example 50 
of a rate converting circuit for color difference signals in the 
digital cam corder shown in FIG. L 

FIG. 8 is a block diagram showing the state of connection 
for a recordiiig mode of the rate converting circuit for color 
difference signals. S5 

FIG. 9is ablock diagram showing the state of connection 
for a playback mode of die rate converting circuit for color 
difference signals. 

FIG. lOo-i is a spectral diagram for illustrating the ^ 
operation of the rate converting circuit for luminaixce sig- 
nals. 

FIG. Ha-b is a timing chart for illustrating the operation 
of the rate convening drcuit for luminance signals. 

FIG. 12 is a block circuit diagram for illustrating an 63 
illustrative construction of a rate converting filter in the rate 
converting circuit f<x luminance signals. 



FIG. 13a-ffl is a timing chart for iUustrating the operation 
of die rate converting filtd: for luminance signals. 

FIG. 14 is a block circuit diagram for illustraling an 
illustrative construction of a coefficient generator in the rate 
conversion filter for Iuminaiu:e signals. 

FIG. 15 is a block circuit diagram for illustrating another 
illustrative construction of a coefficient generator in the rate 
oonveision filter for luminance signals. 

FIG. I6a'-b is a timing chart for illustrating the operation 
of the rate converting circuit for color difference signals. 

FIG. 17a-m is a timing chart for illustratirig the (q)ezatiqn 
of the rate converting filter for color difference sig^ials. 

FIG. 18 is a block dicuit diagram for illustrating an 
illustrative construction of the rate converting filter in the 
rate converting circuit for color difference signals. 

FIG. 19 is a block circuit diagram for iQustrating 
illustiative construction of a coefficient generator in the rate 
conversion filter for color diffiereDce signals. 

HG. 20 is a block circuit diagram fm illustrating another 
illustrative construction of a coefficient generator in the rate 
conversion filter for color diffierence signals. 

FIG. 21 is a graph showing a concrete exan^le of the 
characteristics of the rate amverting filter for luminance 
signals. 

FIG. 22 is a block diagram showing the operating state of 
essential parts for the recording mode of the digital cam 
corder. 

FIG. 23 is a block circuit diagram showing the operating . 
state of essential parts for the i^^back mode of the distal 
cam corder. 

DEE MLED DESCRIPTION OF THE 
PREFERRED IQ^BODIMENTS 

Referring to the drawiiigs, certain preferred embodinoents 
of the present invention will be explained in detail 

The solid state image pidoip apparatus is arranged as 
shown for example in FIG. 1. 

The solid-state imaging device according to the fi rat . 
embodiiDBnt shown in HQ. 1 is a digital cam corder in 
which imaging signals pioduced by an image p«faip unit 1 
are digitized so as to be recorded as picture data conforming 
to the DI standard. The solid-state image pickup apparatus . 
inclodcs an analog4o-digital converting unit 3 to which 
thiee-coto image pickup signals R, G and B produced by 
the image pick-up unit 1 are supplied via an analog signal . 
processing unit 2, a first digital processing unit 4 to which 
the coIot image pick-up data digitized by the A/D convertiiig 
unit 3 are supplied, a second digital processiiig unit 5 to ' 
which a digital luminance signal Y and two digital color 
difference signals C^^, generated by the first digital 
processing unit 4 are supplied, and a signal processipg unit 
for an analog output i. A reoording/reproducing unit 7 for 
recording and reproducing picture data confomxmg to the 
Dl standard is connected to the second digital processing 
units. 

The color image pidoip unit 1 is made up of three CCD 
plate type CCD image sensors IR, IG and IB for separating 
an image pidcup light incident tiieieto from an image pickup 
lens, not shown, via an optical low-pass filter mto dnee color 
light compcments by a color-separating prism, not shown, 
for fomung a three-color picture of an object image. 

In the present embodiment, the three CCD image sensors 
IR, IG and IB are arr^ed in accordance widi a spatial pixel 
shifting mediod in which the red-color image picJo^ CCD 
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image sensor IR and the bhie-oolor image pickiip CCD 
image sensor IB are anayed with a spatial shift of one-half 
the spatial sampling period with respect to the green-color 
image pickup CCD image sensor IG. 

Meanwhile, the present invention may be applied not only 5 
to the three CCD plate type solid-stale image pickup appa- 
ratus constnicted in acconiance with the spatial pixel shift- 
ing method of the present embodiment, but may also be 
^lied to a single CCD or double CCD plate type solid-state 
image pickup apparatus or to a three CCD plate type iq 
solid-state image pickq> apparaXus not constructed in accor- 
dance with the spatial pixel shifting method. 

Each of the dvee CCD image sensois IR, IG and IB is 
driven at an f,, rate by a driving clockCK(f,i) generated by 
a dmmg generator (TG) 9 on the basis of a 2f„ rate dock 
supplied from a voltage controUed oscillator (VOO) 8. 

The number of pixels of each of the three OCD image 
senscffs IR, IG and IB is selected so that the image pickup 
charges are read ocU at a late of f,i=910 f„ for EIA wd at a 
rate of f^i= 912 f„ for CCSR. The oscillation frequency of ^ 
VCD 8 is set to 2f^i, while the timing generator9 is adapted 
for driving the three CCD image sensors IR, IG and IB by 
the f,i late driving clocks CK (f^i) c^Aained by halving the 
frequency of the dodc CK (2f,,). 

The respective color image pickup signals R(f«i), G(f^,) 2S 
and B(f^i), read out at the f,i rate from the OCX) image 
sensOT IR, IG and IB, respectivdy, are siqjplied to the 
analog signal processing unit Z 

The analog signal processing unit 2 is made up of a 
correlated double sampling processing drcuits (CDS pro- 30 
cessmg circuits) 21R, 21G and 21B, and level controlling 
drcuits 22R, 22G and 22B. Tbc CDS processing drcuits 
21R» 21G axxl 21B peribnn conelated double sampling on 
the color miage pidmp signals R, G and B, read out from the 
CCD image sensms IR, IG and IB at the f^^ rate, rcqiec- 35 
tivdy. Besides, the level contioUing drcuits 22R, 22G and 
22B perform levd control, such as white balance or blade 
balance control, on %he cdor image pidoq) signals R, G and 
B, re^)ectively. 

The A/D converter 3, supfdied via the analog dgnal ^ 
process^ 2 with the respective color pidmp signals R(f,|), 
G(f,,) and B(f,|), prodoced by the image-pidaq) unit 1, is 
made }xp of three A/D converters 3R, 3G and 3B, each 
having a word length of 10 bits. These A/D converters 3R, 
3G and 3B are supplied from the timing geoeiator 9 with the 
driving docks Ck (f,,) having a predetermined phase and a 
rate f,, equal to the san^)ling rate of each of the respective 
color image pickup signals R(f,i), G(f,i) and B(f,j). The 
A/D ccmverters 3R, 3G and 3B of the A/D ccmverting unit 
3 digitize the respective color signals R(f,,), G(f,i) and ^ 
B(f^,) at the rate equal to f,, by the above-mentioned driving 
docks CK(f,,), for forming respective digital color signals 
R(fjiX G(f^]) and B(f,,), having the same signal spectrum as 
the spectrum of each of the respective color signals R(f«i), 
G(f,i) and B(f,i), respectivdy. 55 

Meanwhile, the A/D converters 3R, 3G and 3B may also 
be designed to have a word length on the order of 12 to 14 
bits. 

The respective color signals R(f,i),G(f,,) and B(f,i), with ^ 
the rate equal to f^i, digitized by the A/D converting unii 3, 
are supplied to the first digital processing mut 4. 

The first digital processing unit 4 is made up of a first 
digital processing drcuit 41 and a second digital processing 
circuit 42. ^ 

The first digital processing drcuit 41 is activated at the 
rate equal to f^i by the driving docks CR (f^i ) supplied from 
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the timing generator 9 for detecting a variety of correcting 
signal levds of the respective digital color signals R(f,i), 
G(f,,) and B(f,,) supplied from the A/D converting unit 3 for 
stcHing e.g. white balance controlling data, black balance 
controlling data, black shading correction data, white shad- 
ing correctiondataor defect correction data in a memory 43, 
convening the respective color signals into analog signals by 
D/A omveiters 44R, 44G and 44B, and feeding back the 
analog color signals to the level controlling circuits 22R, 
22G and 22B of the analog signal processing unit 2, respec- 
tivdy, for performing white/black balance control, shading 
correction or defect correction. 

Meanwhile, the memory 43 is an SRAM connected to a 
battery 45 as a badoq) power source. 

Thus, in the present embodiment, the respective color 
pidaip signals R(f,t), G(f^t) and B(f,i). read out at the rate 
equal to f,i from the respective CCD image sensors IR, IG 
and IB, are digitized by the A/D converting unit 3 for 
producing the respective color image pickup signals R(f,i), 
G(f^i) and B(f^i), respectivdy, so that the first digital pro- 
cessirig drcuit 41 Diay be activated at the rate equal to f^i for 
performing pixd-based picture processing, sudi as shading 
correction or defect conection. 

On the other hand, the second digital processing drcuit 42 

pffrfnrmft prtnm mhsmrment ppA»gtg1 aAtirinn, nmwKnear 

processing, soch as gamma or knee processing or linear 
matrix processing, on the re^)ective color image pidoip 
agnals R, G and B, processed with the pixd-based process- 
ing by the first digital processing drcuit 41. Besides, the 
second digital prooessmg circuit 42 generates, by the matrix 
processing, a digital lummance signal Y C^ri) two 
digital color difference signals Cjt (f,,) and C^ (f^i) from the 
respective odor image pickup signals R(f,iX G(f,]) and 
B(f,,). 

It is noted that the second digital processmg circuit 42, 
supplied with the docks CK (2f,i), having the rate equal to 
2f,i, from the VCO 8, and with the driving dods CK (f,i), 
having the rate equal to f,„ from the timing generator 9, is 
activated with these docks CK (2f,,) and CK (f,|) as master 
docks for performing wdl-known high resolution prooess- 
iiig corresponding to the spatial pixel shiftir^ method in the 
image pidoip unit 1 for geoerating the digital humoance 
signal Y (2f,|) having the rate equal to 2f,| and the two 
digital color difierence signals Cj, (f^|) and Cg (f,i) each 
having the rate equal to f,,. 

Meanwhile, the master docks CK (2fvj) and CK (f^i) are 
also sui^lied to a syndnonizing sigiml generator (SG) 11 for 
generating various synchronizing signals, such as horizontal 
syndnonizing si^ials HD or vertical synchronizing signals 
VD. 

On the other hand, the second digital processing unit 5 
performs bidirectional rate conversion between signals hav- 
ir^ the data rate rdated to the rate f^] and signals having the 
data rate related to the rate f^. For the recording mode, the 
second digital processing unit 5 converts the signals Y (2f,]), 
Ca (f,,) and C0(f,i), rdated to the rate f^„ generated by the 
first digital processing unit 4, into signals Y (f^, C^ (W^) 
and Cg (f^). related to the rate f^ for supplying the 
converted data to the reoording/reiHodudng unit 7. For the 
playback mode, the second digital processmg unit 5 converts 
the signals Y (f^, {fjl) and Cb (f^), rdated to die 
rate f^ into signals Y (2f,,), C^ (f,i) and C^ (f,i), rdated to 
the rate f,,, for supplying the converted data to the signal 
processing unit for arialog output 6. 

The second digital processing unit 5 is made up of a rate 
converting circuit SOY for the luminance signal and a rate 
converting drcuit 50C for the color difference signals. 



5^21,637 



10 



A digital interface 13 far extemal eqidpmeiit is provided 
b^ween the secoxid digital processing Qnit 5 and the recoid- 
tng/rqxroducing unit 7. For an external input mode, the 
second digital fmxsssing unit 5 converts digital return 
signals Y (fyi), (f^) and Cfl (f^), related to the rate 5 

entered firom a digital camera control unit (D-CCU) 14 
via a camera adapter I>-CA 15, into signals Y (2f,i), (f,i) 
^ tfjiX having the rate f^i. far supfdying the converted 
signals to the signal processii^ unit for analog output 6. 

In the present embodiment, the signal processing unit for iq 
analog output 6 plays the role of an analog interface for the 
signals Y (2f„), C« (f,i) and (f„X related to the rate f,i. 
generated by the first digital procesaqg unit 4 or the second 
digital processing unit 5, and is made up of a, digital/analog 
(D/A) conveiting unit 61 and an analog mi«vW 6Z. 

Tht D/A CQOvrating unit 61 is made up of three D/A 
coDverteis 61Y, 61Ca and 61Cb and three post-filters 
61PFY, 61PFC^ and 61PPC|^ 

la the D/A ocmveiting unit 61^ the digital luminance signal 
Y(2f«]X having the data xate equal to 2f,i, is omvertedmto 20 
an analog signal, which is then &eed of a sampling carrier 
component by the post-filter 61Y playing the roic of a 
Nyquist filter; befbro being supplied to the analog encoder 
62. On the odier hand, die two digital color difiioence 
signals Cj|(f,i) and Cj,(f,i), having the rate equal to f,i, are 2s 
converted by the D/A converters 61Cje and 61Cb into analog 
signals, which then are ficed of samidine cari'iftr compouents 
by the post-filtcn 61FrcA and 6IFPC0 Paying the role of 
a Nyqirist filter, before being supi^ied to the analog encoder 
62. 

30 

The analog encoder 62 is an encoder conforming to the 
usual NTSC OF PAL and is ddapbed for outputting ccHiqxK 
nent signals Y, Cjt and and a oomposite signal CS as weC 
as for ontpntting a monitor signal Y^ to be mpp\ied to a 
view finder 3S 

The analog encoder 62 is constructed as shown for 
example in FIG. 2. 

, in the analog encoder 62, die two analog color difference 
signab and C^, sillied from the D/A conveiting unit 
61, are bandwidth-limited to a predetermined bandwidth, ^ 
with fc being s^ipnndmately equal to 1 MHz, by low-pass 
filten 63Cjt and 630^, and added to by a burst flag BF by 
signal symfaesizcn 64Cjt and 64Cj, befbie being supplied to 
a mortiilator 65. The modulator 65 modulates a quadrature 
2-phasesubcanierSC by the analog color difference signals 
Cjt and Co for generating a modulated chroma signal C^>^ 

On the other hand, the analog luminance signal Y, sui>- 
plied by die D/A converter 61, is a»npensated for delay 
caused by the low-pass filters 630^ and eXg by a delay ^ 
circuit 66, and subsequently added to by a synchronizing 
signal and a setup signal by signal synthesizer 67 to form a 
prescribed luminance signal Y^^^;,^ The luminance signal 
^oun produced in this manner, is improved in resolution by 
digital processutg corresponding to the above-mentioned 
spatial pixel shifting method, whfle containing only little 
aliasing distortion conqponents. 

The luxmnance signal Y^c/r ^ ^ above-mentioned 
mnrinlat e d chroma signal Cqut^ mixed by a signal mixer 
for generating a annposite signal CSch/tn ^ 

On the other hand, the luminance signal Y^^^^ is mixed 
with c har acter signak finom a dtatacter generator 69 by a 
signal mixer 70 and subsequently the mixed signal is out- 
putted via a changeover dicuit 71 as a monitoring signal 
Yy^ The changeover circuit 71 perforins switchiiigb^ween 65 
a return signal RET entered from outside and the above- 
mentioned luminance signal Yq^^ 



Hie signal processing unit for analog output 6 may also be 
so designed that a digital encoder 73, as shown in FIG. 3, by 
a third digital processing unit operated with a dock rate 
related with the rate equal to f,i is employed in place of the 
analog encoder 62. The digital luminance signal 
digital composite signal CS^i^ and the digital monitoiing 
signal Yypt outputted by the digital encoder 73, may be 
converted into analog signals by UiA converter 74Y, 74CS 
and 75Yv^ so as to be oulputtcd via post-filters 74PFY, 
74PFC5 and 75PFYviN 

^9insh the present embodiment, the second digital process- 
ing unit 5 performs bidirecdonal rate conversioD between 
signals having a data rate rdated to the rate of f^^ and signal 
s having a data rate related to the rate of f^ and, as a 
principle, performs conversion from the digital luminance 
signal Y (2f„), having the data rate equal to 2f^i, into the 
digital lununance signal Y(f^, having the data rate equal to 
f^ and from the cfigxtal color difference signals (f,t) and 
Cg (f,i) having the rate equal to f„ into digital color 
difference signals Cj, (fgJ2) and (f^) having the rate 
equal to f^/1, for the recording mode. The second digital 
processing circuit 5 performs conversion from the digital 
luminance signal Y (f^, having the data rate equal to f^ 
into the digital luminance signal Y (2f,,), havii^ the data 
rate equal to 2f,], and from the digital color di£fercnce 
signals Cjt (f^) and (f^) having die rate equal to fgjl 
into digital color difficrence signals (f,i) and Cg (f,|) 
having the rate equal to f^i, for the playback mode. For 
simplifying the construction of the rate oonvenion drcnits 
50Y, fnc, the digital luminance signal Y (f^, having the 
data rate equal to f^ are converted into the digital hum- . 
nance signal Y (2f^ , having die data rate equal to 2f^ 
while die digital color diffierence signals Cj, (fgfi) and 
(f^), having the rate equal to f^/2^ are converted into the 
digital color difference signals (f^ and (f^ having 
the rate equal to f^ frxr the playback mode. 

The dock rate used in the D/A converting unit 61 is also 
changed over to 2f^ f^ and f^ Smce die frequmies f^^ 
and f^ are radier dose to eadi other, the post-filters 61PRY, 
61FFCji and 6IFPC0 niay be used in common without 
changmg their diaracteristics. 

As frxr the word length, a word Icngdi of the order of 10 
bits suffices for signals Y, Cjt and of the digital interfoce 
and the D/A converter 61 .However, the word length for the 
signals Y, Cj, and to be supplied to the second digital 
processing unit 5 needs to be set to a value one or two bits 
longer in view of die roundmg errors brought about in the 
rate converting circuit 

In the present embodiment, 11-bit signals Y, Cj, and 
are generated by the first digital processing unit 4 and upper 
10 bits of the signals Y, Cj, and Cg are supplied to die D/A 
converter 61. The second digital processing unit 5 performs 
imxxssing widi a number of bits two to three bits larger and 
rounding to 10 bits is performed at an end stage. 

Concrete examples of the rate converting circuit 50Y for 
lummance signals and the rate converting circuit 50C for 
color difference signals 50C, making up the above-men-, 
tioned second digital processing tmii 5, are explained. 

The rate converting circuit SOY for linninance signals is 
made up of a half bandfilter 51 Y, a rate conversion filter 52Y, 
a roun^ng circuit 53Y, a delay compensating circuit 54Y, a 
zero-stuffing circuit 55Y and first to sixth changeover cir- 
cuits 56Y ] to S6Yfi for dianging oven the input and the 
output, as shown in FIG. 4. 

For the recording mode, the digital luminance signals Y 
(2f,i) having the rate 2f,„ generated by the first digital 
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processing unit 4, are entered to the half-band filter 51Y so 
as to be sequentially passed through the rate conversion filter 
52Y, rounding circuit 53Y and the delay compensating 
dicuit 54Y, so as to be rate-converted into digital lunmsance 
signals Y(f^ having the data rate equal to as shown in 5 
HG. 3. 

The half band filter 51Y has a passband of f^ for the 
digital lurrnnance signals Y (2f,|) pertaining to the rale 2f^,, 
at an output data rate of 2f,,. Thus the half band filter has 
characteristics of fiincdoning as a Nyquist filter ftx the rate jg 
equal to f^. In the present embodiment, the characteristics 
are so set that 0*0.1 dB (-5.75 MHz), <-12 dB (-6.75 
MHz), dB (8.0 MHz). 

On the other hand, the rate converting filter 52Y sup- 
presses 1st to (n-l)di order carrier components of the hi^ier 
order caiiier components contained in the digital luminanoe 
signals Y (2f,i) having the rate 2f,i supplied via the half 
boDd filter 51Y. The rate converting filter 52Y inchides an 
equalizing filter operated at the rate equal to 2f,i for com- 
pensating the attenuati(Mi produced in the above-mentioned 
band of the half band filter 51 Y. ^ 

The digital luiniriance signals Y (f^, produced by the rate 
ctmverting filter 52Y, are processed by the rounding circuit 
53Y with scaling, dipping and Founding and subsequently 
processed withdday compensation with respect to the color 
difference signal channel by the delay oompensaHon circuit ^ 
54 before beoig outputted. 

It is noted that the rate convertiiig circuit SOY for lumi- 
nance signals petfoans rate coaversion of from 2 m to n for 
a frequencies f^^i-nhiu where m and n are positive 
integers. For coping with a system in whidi phiral f^i rates ^ 
exist, depending on the number of pixels of the EIA/CCIR 
OF CCD image sensors, plural rate canversion rates may be 
variably set, as shown in Thble 1, so that the operation may 
be made with plural modes. 

35 
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It is necessary for the rate conversion circuit 50Y to 
change the characteristics and (qieration of the rate conver- 
sion responsive to the respective modes. However, since the 
values of f,, are doser for the respective modes, the half 
band filter 51Y may have common characteristics, while it 
is only necessary to change the charact^dcs and operation 
of the rate conversion filter 52Y. 

Also, for the playback ooode, the rate converting circuit 
50Y for luminance signals has its first to sixth changeover 50 
circuits 5^^ to set as shown in FIG. 6. 

That is, for the playback mode, the f^ rate digital lumi- 
nance signals Y (f^ reproduced by the reoording^replay unit 
7 are supplied to the delay compensation circuit 54Y for 
dday compensation with respect to the color diffraence 65 
signal chaimel before being outputted via 0-stuffing circuit 
55Y to the half band fiher 51Y. 
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The 0 stuffing dicuit 55Y inserts Os between samples for 
up-conversion of the digital luminance signals Y (f^ having 
the rate equal to f^ to the rate of 2f,2- ^ ^ replay mode, 
the half band filter plays the role of a rate-raising converting 
filter of raising the frequency ftom f^ to 2f^ by suppressing 
odd-number order carrier components for the digital lumi- 
nance signals Y (f^ having the rate equal to 2f^. 

The digital huninance signals Y(f^ having the data rate 
equal to 2f^ produced by the half band filter 51Y are 
processed by the rounding circuit 53Y with scaling, clipping 
and rounding before being outputted. 

Meanwhile, the rate converting filt^ 52Y is not emfrfoy ed 
for replay. 

The rate converting circuit 50C for color difference sig- 
nals is made up of a multiplexoiydemultiplexQr (MPX/ 
DMPX) 51C. a half band filter 52c; a rate amverting filter 
53C, a rounding circuit 54C a 0-stuffing circuit 55C and first 
to fiorurth changeover dxcdts 56C, to 5€C^ as shown in FIG. 
7. 

For the recording mode, the rate conversion circuit 50C 
has its first to fourth changeover circuits 56Ci to 56C4 set as 
shown in FIG. 8. 

That is, far the recording mode, the f,i rate digital colcv 
difference signals Cj, (f,i) , C^ (f,i), generated by the first 
digital processing unit 4, are arrayed in a point-sequential 
manner by the muitqilexoi/demultiplexar (MFX/DFFX) 
51C so as to be entered as the 2f^i rate digital point- 
sequeotia] color difference signals (2f,,) to the half 
band filter 52C. Hie digital point-sequential color difiierettoe 
signals are passed through the rate converting filter 53C and 
the rounding circuit 54C, m this order; so as to be outputted 
as the f^ rate digital point-sequential color difference signals 

The half band filter 52C has a passband of f^ for the 
digital point-sequential color difference signals CJC^ 
(2f^i)t at an ou^ data rate of 2f,i. Thus the half band filter 
has characteristics of functioning as a Nyquist filter for the 
rate equal to f^. 

On the other hand, the rate converting filter 53C sup- 
presses the Ist to (n-l)th order carrier compraents of the 
higher order carrier components contained in the digital 
luminance signals Cj/C|, (2f,,) with the rate 2f,|, supplied 
via the half band filter 52C. The rate converting filter 53C 
iiKludes an equalizing filter operated at the rate equal to 2f,i 
for compensating the attenuation produced in the above- 
mentioned band of the half band filter 52C 

The digital point-sequential f^ rate for the digital pomt- 
sequentially color difference signals Cj/C^ (f^, produced 
by the rate converting filter 53C, are processed by the 
rounding circuit 54C with scaling, clipping and rounding 
before being outputted. 

It is noted that the rate converting circuit 50C performs 
rate conversion of from 2 m to n for frequencies f^^^^-n/m, 
where m and n are positive integers. For coping with a 
system in which plural f^j rates exist, depending on the 
number of pixels of the EIA/CCIR or CCD image sensors, 
plural rate conversion rates may be variably set so that the 
operation may be made with plural modes. 

It is necessary for the rate conversion circuit 50C to 
change the characteristics and operation of the rate conver- 
sion responsive to the respective modes. However, since the 
values of f^, are closer for the respective modes, the half 
band filter 52C may have common cfaaiacteiistics, while it 
is only necessary to change the characteristics and operation 
of the rate conversion filter 53C 
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Also, for the playback mode, the rate converting drcuil 
50C for hmrinance signals has its first to foaith changeover 
dinnts 56C| to S6C4 set as shown in FIG. 9. 

That is, for die playback mode, the f^ rate digital point- 
sequential color diffexoice signals Cg^g (f^ reproduced 5 
by the leooxding^rqilay miit 7 are supplied via 0-stuffing 
dicuitSSC to the half band filter 52C 

The 0 stuffing circuit S5C inserts Os between san^les for 
upconversioo of die digital point-sequential color differ- 
ence signals CJC^ (f^ to djc rate of 2f^. For the replay 10 
mode, the half band filter 52C plays die role of a rate-raising 
converting filter of laismg the frequeaocy from f^ to 2f^ by 
suppressing odd-number order earner components for the 
2f^ rate digital prant-seqaeotial coIot difference signals 

The 2f^ rate digital point-seqnenlial cdor difference 
signals Cj^^ (2f^, produced by the half band filter 520, 
are proc^sed by the rounding circuit 54C with scaling, 
clipping and rounding and arrayed into coDCDnent signals by 
the MFX/DMFX 51C befoie being outputted as f,i rate 20 
digital color diffiocnce signals Q (f,,) and (f,^). 

Meanwhile, the rate ccmverting filter 53C is not employed 
for the playback mode. 

In this mannei; the rate converting drcoit 50C for color 
Affeicnce signals hfflidles the f,i rate digital color difference ^ 
signals Cj^ (f,j) and (f^i) as the 2f,i rate digital point- 
sequential color difference signals Cj^/Cg, so that the hard- 
ware may be dhnhushed in scale, while it becomes possible 
to use the prooessintg of die same nature fcK" the two aAac 
(fifferBDoe signals. 30 

Meanwhile, in the pocsent embodiment, in an ouQxit stage 
of the hmmianoe sigiial channel of die second digital pro- 
cessing circuit 42 in the above-mentioned digital processing 
unit 4, a dd^ compeasatian circuit 42DLY is provided in a 
hmnnance signal channel. ^ 

The delay compensation drcoit 42DLY is used for com- 
pensating die delay caused in the low-pass filters €3Cft, 
GCg of die analog encoder C2 in the signal processing unit 
for analog output 6. The delay quantity <^ die delay com- ^ 
pensation circuit 42DLY is so set that, if only the compraent 
signals Y, Cj^ and from the signal processing unit € art 
used, die delay compensation circuit is used for compcosat- 
iog die delay caused in the post-filters 61FFY, 61FFCj( and 
61ITCgOfdieIVAconvertmgunit61and,iftheconq)oiient 
signals Y, Cj, and are not used but the conqxsite signal 
CS or Y/C is used, the delay compensation circuit is used fw 
conqiensatiitg die dday of die low-pass filters GCgt, GCg 
of die analog encoder 62. 

Meanwhile, die difference in dday between die post filter 50 
61PRY and die post filters 6im:A and 61PFC^ is usuaUy of 
a small vahxe (m the order of cxie or two docks based on the 
f^i rate and may be cnrected at any location in the process- 
ing system. 

Besides, in die present embodiment, the respective delay 55 
quantities are so set that, with the dday quantity of each of 
the low-pass filters lS3Cj, and 630^ of die analog encoder 62 
equal to DL^,^ the delay quantity of a delay compensation 
drcuit 66 thereof being DL^, the delay quantity of the delay 
compensation drcuit 42DLY provided at the output stage of 60 
the luminance signal channel of the first digital processing 
tmit 4 bdng DL„ the dday quantities of the half band filter 
52Y, rate convertmg filter 53Y and the dday compensation 
circuit 54Y of the rate ccmvetting circuit SOY for the 
Imninance signals bdng DL2,DL3 and DL,respectivdy, and 65 
widi the dday quantities of die half band filter 52C and the 
rate converting filter 53C of die rate converting circuit 50C 
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for die color difference signals being DL4, and DL,, respec- 
tively, die equations 

and 

hold for die recording and playback modes, respectivdy. 

It is noted that the effective processing rate of the rate 
converting circuit 50C for o^or difference signals is lower 
than that of the rate converting circuit SOY for himinance 
signals, such diat the inequalities DL2<DL4 and DL3<DL3 
hold. 

An illustrative operation ofthe rate convertmg circuit SOY - 
for die luminance signals for converting the 2f^i rate digital 
luminance signal Y (2f,i) genmted by the first digital 
processing unit 4 into f^ rate digital luminance signal Y (f^ 
is explained for die rate conversion ratio of from 19tD9,that 
is for f^l8f,,/19, by lefening to the spectrum diagram 
shown in FIG. 10 and to the timing chart shown in FIG. 11. 

That is, for the recording mode, the 2f^i rate digital, 
lummance signal Y (2f,|) with the spectrum as shown at (A) 
in FIG. 10, generated by the first distal processing unit 4 

^si) t is bandwidth-limited to die Nyquist . 
frequency widi respect to die fj2 rate, by half-band filter SlY 
having characteristics shown at (B) in FIG. 10, so as to be . 
siqiplied to die rate convotiiig filter 52Y as 2f,| rate digital 
lummance ngnal Y (2f,i) (bandwiddi: 0~f^). 

That is, die digital luminance signal Y (2f,i), constituted 
.by a set of samples {a^ with the rate equal to 2^}, shown 
at (A) m FIG. 11, is bandwiddi-lhnited by die half band filter 
SI Y to die Nyquist finequency with respect to the f^ rate, 
so as to be supplied to the rate coaveiting filter S2Y. 

For the set of sanqiles {b^, having die 2f,i input rate, die 
rate converting filter 52Y divides the interval between 
neighboring samples into nine equal parts, and causes the 
ofigmal samples to rcmam at pomts li^ere the samples {b^} 
exist, shown by 0 at (B) in FIG. 11, while stuffing 0 samples 
at points where the samples {b^ are absent, as indicated by 
dots at B in FIG. U , for transforming the sanqde set into a 
set of samf^es {jbA having a rate of 9x2f,i=18f,i. The rate 
converting filter ^Y also generates a 18 f^, rate interpolated 
sanies by taking a convolution of the impulse response 
{hp} of the rate converting filter represented by the 18 f^j 
rate and the sample set having die 18f,i rate. Meanwhfle, an 
imaginary imerpdatcd sample set by die rate converting 
filter S2Y and an output sample set having the rate {c^ 
are in dicated by x and ©, at (B) in FIG. U, respectivdy. 

The rate converting filter S2Y has characteristics in 
which, as defiiied at (D) in FIG. 10, it has a passband of 
kxl8f,,^f^ k being an integer, and a stop band of 
gxl8f,|if^ g bdng an integer. Thus die rate converting filter 
S2Y inhibits die 2f,] sampling carrier components in the 
vicinity of 2f,t and 4 to 16 f^^ of die 2f,i rate digital 
luminance signals Y(2f,i) sopj^ed from die half band filter 
SI Y, indicated at (Q in FIG. 10. In dus manner, the 2f,i rate 
digital luminance signal Y (2f,i) are turned into digital 
Imninance signal Y (18f^,), raised to a rate nine times as 
mudi as die qngmal rate, or 18f,, rate. 

The bandwidth diarscteiistics of die digital hmnnance 
signals Y (18f,i) represent die f^ rate Nyquist characteris- 
tics as defined by the half band filter SI Y. 

It should be noted that die filtering to the 18f,i rate is 
imaginary and in effect an output sample set {c^ having the 
rate equal to f^ produced by down-sanqiling die 18f,i rate 
output sample train for every 19 samples. 
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Thoefore, the oonvohiticni between the 1 8f,i rate impulse 
response {hp} and the 18f,i rate sample set {b^} needs to be 
carried out for the. case of die sample tram {b^} being 
non-zeiD sample train {b„}, such that it suffices to cany out 
the processing q)eratioiis of S 



Co = tL9 b, + ho bto + hp t>-i 
c, = iLe bj + h| + hio bi 
c, = h.7 b, + ha b* + h„ bj 
C3 = hHib, + h3b6 + hubs 
C4 = h-5 b, + h* ba 
Cs = h.4 bii + h5 bio 
c< = h_i2 + h_3 bi3 + b« bia 
C7 = h„ii bi4 + h_2 bi5 + b7 bi4 
c, = h_io bie + h_| bn + h^ bi^ 
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These proce8si4g operations may be earned out at e.g. the 
f^, rate or at the rate. 

In the above-mentioned rate converting opmtions by the 
rate converting circuit SOY, the following three conditions 
are characteristically criticaL 20 

Hrst condidom That the 2f^, rate digital luminance signal 

Y (2f^i). siq)plied to the half band filter 51Y, shown at (A) 
in FIG. 10, has die same diaracteristics as those of the 18f,i 
rate digital himinance signals Y(18f,,), shown at (E) in FIG. 
10, ratfr-iaised by the rate converting fillor 52Y to the 18f,t 
rate which is imaginarily nine times as mu^ as the original 
rate, as kmg as the bandwidth of &om 0 to f^ is concenied, 
that is that the bandwidth of 0 to f^ of the cfaaracteiistics of 
the product of the characterisdcs of the half band filter 51Y 
shown at (B) in FIG. 10 and those of the rate converting filter 
5ZY shown at (D)m FIG. 10 may be approximated to unity. 30 

Second Cooditioii: That 2f^, samplir^carrio^compraents 
of die digital himmance signals Y(18f,i), rate-raised to 18f,i 
rate, shown at (E) in HG. 10» be sopporessed soffidendy, as 
long as the range of fsvm f^ to (18f„-fc) is concerned, that 
is that die characterisdcs of the prodiict of the diaracterisdcs 35 
of the half band filter 51Y shown at (B) in FIG. 10 and the 
characterisdcs of the rate converting filter 52Y shown at (B) 
in FIG. 10 may be qxpioximated to 0 as long as the range of 
from f^ to (18f^,-f3 is concerned, above all that the diar- 
acteristics of the rate ccmverting filter 52Y shown at (D) in 40 
HG. 10 becomes 0 as Icmg as the range of from 7f,i to 16f^i 
is concealed and no (a2f,i-pf^ component is generated at 
the output when the input is the direct current, and further 
that the characterisdcs of die product of die characteristics of 
the half band filter 51Y shown at (B) in FIG. 10 and diose 4S 
of die rate converting filter 52Y shown at (D) in FIG. 10 be 
suffidendy suppressed as l(«g as the range of from If^ to 
18f^ is concerned. 

Third Condition: That dse filter characteristics of the rate 
converting circuit SOY be so set that die frequency charac- 50 
teristics in the vicinity of f^ of the digital luminance signal 

Y (ISf,,) shown at (E) in FIG. 10, raised in rate to miagi- 
narDy to mne tin^ as much as the original frequency, or to 
18f^, rate, by die rate converting filter 52Y, be widiin a 
prescribed value range. 55 

With the rate converting circuit SI of the present embodi- 
ment, die 2S,i rate digital luminance signal Y (Tf^^) is first 
passed duDu^ die half band filter 51Y to satisfy die first and 
the second conditions, while the third condition may be 
satisfied by die rate converting filter 52Y. Besides, since the 60 
half band filter SI Y is an FIR filter having a fixed coeffident, 
the drcuit size may be reduced by employing various filter 
designing m^hods. The rate converting filter 52Y, which is 
a variable coeffident filter, necessitates a multiplier. How- 
ever, it may be constructed easily because it has smooth 65 
roll-off characteristics and subjected to only little constraint- 
concerning die stop band, as shown at (D) in FIG. 10. 



For example, the impulse response {h.} of the rate 
converting filler 52Y may be expressed by 24 orders of 

{1, 3. 6, la 15, 21. 28, 35, 43. 49, 54. 57, 58, 57 ... >/78 

while diree of the multipliers of the rate converting filter 
S2Y suffice. The word lengdi of die coeffident becomes 6 
hits in his case to simplify the coeffident generator or the 
multiplier. 

The rate converting filter 52Y of die rate converting 
circuit 51 may be constructed as shown for example in FIG. 
12. 

The rate converting filter 52Y shown in FIG. 12 executes 
the above-mentioned processing operations at the output rate 
of f^ to generate a sample train or set {cj of the f^ rate 
from the sample train {bj of die 2f,i rate. Thus it is made 
up of four-stage shift registers 151, a data re-arraying drcuil 
152, latch circuits 153A, 153B and 153C, diree coeffident 
generators 154A, 154B and 154C multipHers 155A, 155B 
and 155C an adder 156 and a latch circuit 157. 

The sample train {b J of die 2f,| rate, shown at (A) in 
FIG. 13, is supplied in series to die shift register 151 of the 
rate craverting filter 52Y. The shift register 151 is operated 
by die 2f,i rate clocks CK (2f,,) for sequentially delaying 
die sample train {b J of die 2f^ , rate. A 1 -dodc delay output, 
a 2-dock delay output, a 3-dock dday output, and a 4-dock 
delay output, shown;at (B), (O, (D) and (E) in FIG. 13, of 
the sample train {b^, produced by the four-stage shift 
register 151, are supplied in paralld to the data re-arraying 
circuit 152, at the 2f,i rate. 

The data re-arraying circuit 152 re-arrays at the f^ rate the 
I-dodc delay output, 2-dock dday output, 3-dodc delay 
output and the 4-dock delay output, entered in paralld frtnii 
die shift register 151 at the Zf^^ rate, for generating duree 
different sample trains {b J^, {b and {b employed for 
the above (Hocessing operatiras, as shown at (F), (G) and 
(H) in FIG. 13. The f^ rate san^le trains {bjj^. {bj^ and 
{b«}c. generated by the data re-arraying circuit 152, are 
supplied via die latch circuits 153A, 153B and 153C to the 
multipliers 154A, 154B and 154C 

On the other hand, the coeffident generators 155A, 155B 
and 155C sequentially generate the three different multipli- 
cation coeffidents A^oef* ^ccwef and Ccobf* employed for 
the above-mentioned processing operations. Of these coef- 
fident generates 155A, 155B and 155C die coeffident 
generator 155A sequentially snpplies the nmhiplication 
coefi&dents Acoef {h-9» ^> ^> 0» ^-12^ ^ 
h_io}, as shown at (I) in HG. 13. to die multiplier 154A. The 
coeffident generator 155B sequentially supplies die multi- 
location coefficients B^oef ^ ^3* ^ ^ ^3 ^2 
and h_i }. as shown at (J) in FIG. 13, to die multiplier 154B, 
while die coeffident generator 155C sequentially su{^lies 
die multiplication coeffidents Ccocf 0^ ^io» ^ ^ii* ^12* 
0. h^, hfi. and hg}, as shown at (K) in FIG. 13, to die 
multiplier 154C. 

The multipliers 154A, 154B and 154C perfonn an opera- 
tion of paralld multi(^cation of multiplying the latch out- 
puts of die latch circuits 153A, 153B and 153C that is the 
fy2 rate sample trains {b J^, {b and {b Jo generated by 
the data re-arraying circuit 152, by the diffoent multiplica- 
tion coefficients Acoef* ^coef ^coef supplied from 
die coeffident generators 155 A, 155B and 155C, at die f^ 
rate. The multiplication mtpats of die multipliers 154A, 
154B and 1S4C are supplied to die adder 156. 

The adder 156 adds the multiplicatira outputs of the 
multipliers 154A, 154B and 154C to calculate die f^ rate 
sample trains {cj, that is 
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TTic rate saiiq)lc trains {cj, generated from the 2f,i 
rate sample trams 0>n}* sequentiaUy ooQutted via 1^ 
ciicuit 157. as shown at (M) m FIG. 13. 

For the pxesent concrete example of f^l8f,i/19, it suf- 
fices to cause the multiplication ooeffidents Acoep» ^coef 
3^ ^coBF* employed for the above-mentioned processing 
operations, to appear cyclically at the mteral of nine docks 20 
of f^ so that the coefficient geaeratois 155 A, 155B and 
155C may be easily arranged as shift registers, as shown for 
example in FIG. 14. 

The coefficient generator 155, shown in FIG. 14, is made 
tq> of first to third shift registers 161, 162 and lti3,0(HmectBd 25 
in tandem, a first switching drcoit 164 for changing over the 
docks of the shift niters 161, 162 and 163, a second 
switching dront 165 for changing over the outputs and a 
contcol drcoit 166 for ocmtrolling the operation of tbc 
switdung ctxcuits 164, 165. 30 

Each of the first to third shift registers 161 to 163 has its 
dock mput tennmal sdectivdy connected via the first 
switching circuit 164 to first or second clock inpnt terrninalft 
160A 16IIB. Besides, the first shift register 161 has its data 
input terminal selectivdy connected via the second switch- 35 
ing circuit 165. to a data ou^ terminal of the first shift 
register 161, a data output tenninal of the seoHid shift 
register 162, a data output terminal of the third shift Twister 
163 or a coefficient data iiqnit terminal 160C llie first shift 
register 161 is a six-stage shift register having its data output 40 
terminal connected to the coefficient data output tenninal 
155C. The second shift register 162 axKl the third shift 
register 163 are three-stage and 24-stage shift registers, 
respecttvdy. 

The first dock input tenninal 160A is stqjpiied with f^ 45 
rate docks CK (f^. The second dock mput terminal 160B 
is supplied with load docks LDCKI firom asystem control- 
ler; not shown. The coeffident data input terminal 160C is 
supplied with coeffident data CX>EFI from the system 
controller, whOe the control circuit 166 is supplied from the 50 
synchronizing signal generator 11 with ahodzcmtal synduo- 
nizing signal HD from the synchronizing signal generator 
11, while being supplied with a mode signal MOD£I from 
the system controUa: 

In the iRcsent coefficient generator 155, the switching 55 
circuits 164 and 165 are controlled in the foUowing maimer 
by the oonizol circuit 166 responsive to the mode signal 
MODEI supplied from the system controUer, not showiL 

That is, when starting the camera operation, the first 
switching circuit 164 sdects the load dock LDCKI siqyplied 60 
finnn the system controllei: During the normal operation, the 
first switching circuit 164 selects the f^ rate dock CK(f^. 

When starting the camera <^)eration, the second switdung 
circuit 165 sdects the coeffidem data CX>EFI supplied from 
the system coniioUer. During the normal operation, the 65 
second switching circuit 165 sdects output data of the first 
to third shift registers 161 to 163, that is, it selects the ou^ 



data of the first shift register 161, the output data of the 
second shift register 162 or the output data of the third shift 
register 163 for the modes 1, 2 and 3, respectivdy. 

With the above-described arrangement of the coeffident 
generator 155, the coeffident data COEFI required fcH* rate 
conversion at the desired rate conversion ratio is supplied, at 
the time of starting the camera, from the system controller 
to the data input terminal of the sMit register SRI via the 
second switddng drcuit 165 for syiidnonized writing at the 
required stage numbers of the first to third shift registers 161 
to 163 by the load docks LDCK for setting the coeffident 
data COEFI having the desired conversion ratio in the first 
to third shift registers 161 to 163. 

For the normal operation, the coeffidem data as set in the 
first to thu J shift registers 161 to 163 arc recycled respon- 
sive to the operatmg mode by docks CK (f^ at the f^ rate 
for real-time ouQmtting of the multiplication coeffident 
COEFI required for rate conversion at the desired rate 
conversion ratio. 

That is, for nuxle 1, by recycling the coeffident data 
COEFI as set in the first shift register 161 at the f^ rate by 
the docks CK (f^ , wherein, according to the equation r 
f^l2f,i/13, the multiplication coefficient OOEF necessary 
for rate conversion at the rate conversion ratio of fipom 13 to 
6 is ontpiitted. 

For mode 2, by recycling the coeffidem data COEFI as set 
in the first shift register 161 and the second shift register 162 
at the f^ rate by the docks CK (f^^, wherein, accocding to 
the equation fjz=18 f,i/I9, the multiplication coefficient 
COEF necessary for rate conversion at the rate conversion 
ratio of from 19 to 9 b ontpotted. 

For mode 3, by recycling the coeffident data COEFI as set 
in the first shift register 161, second shift register 162 and in 
the third shift register 163 at tite f ^2 rate by the docks CK 
(f^ , whodn. acconling to the equation f,^3f,i/35, the 
multiplication coefficient COEF necessary for rate conver- 
sion at the rate conversion ratio of from 70 to 33 is outputted. 

The coefficient generator 155 may be constructed by a 
random access memosy 171 , an address contrd c ir c ui t 172, 
a control circuit 173^ etc., as shown in FIG. 15. - 

In the coeffirimt geiterator 155, shown in FIG. 15, the 
coxitrd drcuit 173 perfofms the fr)Ilowing control operations 
responsive to the nnde signal MODEI supplied from the 
system controllei; not showiL 

That is, when starting the camera, the address control 
circuit 172 is controlled for generating write addresses 
responsive to load docks LDCK supplied from the system 
controller, not showri, while controlliiag the random access 
memory 171. During the normal operation, the control 
circuit 173 controls the address control circuit 172 for 
generating Uie readout addresses responsive to the f^ rate 
clocks CK (f^, wfafle controlling the readout of the random 
access memory 171. 

When starting the camera, the coeffidem data COEFI, 
necessary for rate conversion at the desired rate conversion 
ratio is written from the system ccmtroUer, not shown, in the 
random access memory 171 via the control circuit 173. 
During the normal operation, the coefBdent data COEFI as 
set in the randmn access memory 171 is repeatedly read at 
the f^ rate by die clocks CK (f^, while the multiplication . 
coeffident CC^F required for rate conversion at die desired 
rate conversicm ratio is ouQmtted on the real-time basis via 
the latch circuit 174. 

On the other hand, the rate conversion circmt 50C for 
color difference signals in the present embodiment handles 
digital color differeiKX signals Cj^f,,) and C^ (f^^) , having 
the rate equd to f,i, as 2f^i rate digital point-sequCTtial color 
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diffefcoce signals Cj/C^ as menticHied above. Similariy to 
the rate conversion circuit SOY for luminance signals, the 
late converting drcuit 50C far the above-mentioned lumi- 
nance signals performs the rate conversion of from 2 m to n 
with the frequencies given by f^f^^i^n/jR, with m and n ^ 
being positive integers, as shown in timing charts of FIGS. 
16 and 17, showing the operation for the rate conversion 
ratio of f^l8f,i/19. that is from 19 to 9. 

The rate conversion filter 53C for the rate conversion 
circuit 50C for color difference signals may be constructed 
similarly to the rate conversion filter 52Y for the rate 
conversion circuit SOY for luminance signals. Thus, as 
shown in FIG. 18, the rate convcrston filter SBC is made up 
of a four-stage shift register 251, a data re-arraying circuit 
252, latch drcuits 253A, 2S3B and 2S3C, three multipliers 
254A, 254B and 254C coeffidem generators 255A, 255B 
and 25SC, an alder 256 and alatch drcuit 257, as shown in 
HG. 18. 

The coeffidem generators 2S5A, 255B and 255C of the 20 
rate conversion filter S3C may be made up of first to third 
shift registers 261, 262 and 263, connected m tandem, a first 
switching drcuit 264 for chaoging over the docks of the 
shift registers 261, 262 and 263, a second switching drcuit 
265 for dianging over the outputs and a control circuit 266 25 
for contnriling the operation of the switdnng circuits 264. 
265, as shown in HG. 19, or of a random access memory 
271, an address control dicoit 272 and a control circuit 273 
etc, as shown in FIG. 20. 

Since the operation of the rate conversion filter is the same ^ 
as that of the rate convertiQg filter 52Y for kmunance 
signals, the corresponding operatimi is not made for brevity. 

It will be noted that, in the rate converting operation 
iirdicated by nx2f^^^nf^, such as rate conversion of from 19 ^ 
to9form=19andn=9, the 2f,i rate input data set has a large 
energy at a frequency an integer number 1 -{n- 1 ) of times of 
2f,, . Thus it suffices fiar the rate oonvertrng filter performing 
the rate conversion to have filter characteristics which will 
suppress the canier components of tbese firquendes and 40 
higher-order carrier side band frequendes. Thus the rate 
conversion filter needs to have an in^nilse response of an 
integer number coefBdent given by devdoping a prodoct H| 
(z~*)xHj (2"*) of a first transfer fimction H, (z~") having a 
zero point at the frequency nx2f,i and a second transfer 45 
function H2 (z~^) having zero points above and bdow the 
frequency nx2f,}. 

That is, it is possible for the rate converting filter S2Y for 
luminance signals to have an inqmlse response of an integer 
coefficient having at least one zero point at nx2f,j and two so 
zero points in the vidnity thereof, while it is possible for the 
rate converting filter S3C for color difference signals to have 
an impulse response of an integer coefficient having at least 
one zero pomt at nxf,, arxi two zero points in die vidnity 
thereof. 55 

The first and second transfer functions Ht (z~^) and 
(z"') may for example be given by the foUowing equations: 
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The first transfer function H} (z~') has an (n-l)di order 
integer coeffident and is given for example by ^ 



The second transfer function H2 (z ^) has an 2(n-l)th 
ordo^ integer coeffident and is given for example by 

7r* + 8r ' + ftr* + r " + 2r " + 
a^u + 4j-u + 5^12 + fir" + 7r" + 

7r« + 7r' + 7r* + 7r^ + 7r *o + 

whereby the rate conversion filter has a 3nth order integer 
coeffident and has characterisdcs as shown in HG. 21. 
Mean\^iile, z~^ is a unit delay operator corresponding to 
nx2f,i. 

V/ilh the data string entered to the rate converting filter; 
since real samples are present at an interval of n with respect 
to the impulse re^xmse of the rate converting filter, three 
multipliers suffice for perf (Kming an actual omvohidoiL By 
operating the rate con verting filter only for suppressing high 
carrier components of 2f.i, the number of the nmltipliers 
necessary far die actual circuit may be diminished Although 
the roU^yff of the arnplitude characteristics becomes blunt in 
the vidnity of die base band, it may be corrected in advance 
by die half band filter: 

^th the above-described digital cam corder, the image 
pckup signals R, G and B outputted firom the solid-state 
image sensors IR, IG and IB of the image pido^ unit 1 
driven at the f^^ rate are digitized at the f,| rate at the 
predetermined i^iase by the A/D converting unit 3, and at 
least the digital luminance signals Yarui the two digital cdor 
difference signals Cj, and are generated by the first digital 
processing unit 4 operated at a dock rate related with the f^i 
rate, so that digital picture signals having an excellent 
picture quality may be obtained without soffiering firom beat 
interference. 

For the recording rmxle, as shown in FIG. 22 showing die 
operatiiig state during recording, the f,^ rate related digital 
Imninance signals Y and the two digital color difference 
signals Cj, and C^, generated by die first digital processing 
unit 4, are converted by the second digital processii^ unit 5 
into f^ rate rdated digital luminance signals Y and two 
digital color difference signals Cjip, so as to be supplied 
totherecording^reproducingunit?, while the f,i rate rdated 
digital luminance signals Y and the two digital color differ- 
ence signals Cj^ are outputted via the signal processing 
unit 6 for analog output 6. Also, as shown in FIG. 23 
showing the. qierating tttate during the playback mode, the 
f^ rate related digital luminance signals Y and the two 
digital color difference signals Cj^ reproduced by tte 
recording^eprodudng unit 7 are converted by die second 
digital processing unit 5 into f,i rate related digital lumi- 
nance signals Y and the two digital color difference signals, 
Cjt and so as to be outputted via the signal processing 
unit for analog output 6. 

Tliat is, with the present digital cam corder, tte second 
digital processing unit 5 has the function of bidirectional rate 
conversion between the f,i rate rdated data rate and the 
rate related data rate. T^is, for die recording mode, the 
second digital processing unit 5 outputs the digital lumi- 
nance signals Y and the two digital color difference signals 
and Cp, generated by die first digital processing unit 4, 
via the signal processing unit 6, while supplying the same 
signals to the recording^reproducing unit 7 via the second 
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digital processing unit 5. Fot the playback mode, 
digital processing unit 5 supplies the rate related data rate 
signals Y, Cj, and reproduced by the recording/repro- 
dudng unit 7« to the signal processing unit 6 via the second 
digital processing unit 5. while ouQnming playback signals 5 
via dte sigiial processing unit 6, so that the rate related 
data rate signals Y, and may be recorded and/or 
rqntxluced by the reconling^reprodudng unit 7. 

Besides, with the present digital cam corder, the second 
digital processing unit 5 may set plural rate conversicm ratio, lo 
the mput data signals Y, Cff and C|, rdated to the f,i rate are 
con verted to the aatpat data signals Y, C^^ and related to 
the rate. So that, by employing the standard CCD image 
sensor as CCD image sensor IR, IG and IB of the image 
|rick-op unit 1 , die digital imaging signal at D-1 standard is 
dock rate or other dock rate may be obtained. 

On the other hand, with the present digital cam omler, the 
first digital processing unit 4 gennates the 2f^| rate digital 
hnmnance signals Y(2f,,X the second di^i^alfsocess- 

unit 5 pcarfbnns rate conversion of from to f^ on the 20 
dighal luminance signals Y (2f^,), for the receding mode. 
Besides, for the playback mode, the second digital process- 
ing unit perfonns the rate convenion of from f^ to 2f,i or 
to 2f^ on the fj^ rate digital himmance ngnals supplied from 
the recording^iepiodndng unit 7, so that it becomes possiUe 2S 
to simplify the construcdon of die second digital processing 
umL 

On the other hand, the second digital procesamg unit 5 
opentes for the recoidiog mode at the dock rates of 2f^ f^ 
and f^ to pl^ the role of a Nyquist filter for the signals 30 
Y(2^i). and C^ (f,i), with the dock rates of f^ 

f^4 and ^4. For the plsybadc mode, the second digital 
pnicessmg unit 5 operates at the dodc rates of 2f^i,f^i and 
ti. so that the half bandfiUers 51Y, $2C having the same 
frequency characteristics as those during the leoHding mode 35 
is einplayed for both the playbadc and recording modes. 
Thus, dating the recording mode, die second digital pro- 
cessing mut 5 processes the signals Y(2f,i), Cj, (f,,) and C^ 
(f^i ), supplied torn the rate converting filters 52Y and S3C 
via the halfband filters 51Y and 520, by perfOTming the iHte 40 
convenion of from 2f,i to f^ on the digital luminance 
signals Y .(24i), and by perfonmng the rate conversion of 
from f^t to on dw digital color (fifferenoe signals Cj^ 
tf,,) and C^ (f,i). The constructioQ of the second digital 
processing unit 5 may be simplified in this manner by 4S 
co^jkyying the half band filters 51Y and 52C in common for 
the playback and recording modes. 

Besides, the second digitid piocessmg unit 5 limits the 
bandwidth of the input data rate signals Y, Cj, and Cg, 
generatedby the first digital processing unit 5, by half band SO 
filters 51Y and 520, having f^ f^4 and f^4 as the 
passbands, with the output data rate of 2f^i, f,, and f,„ and 
perfonns rate oonversicm of from 2f,i to f^ f^, to f^ or 
f^4 and from f,i to f^ or f^4 to output the low-order 
linear phase finite inqnilse response suffident to suppress 55 
high order sideband con^xments m die vicinity of nx2f,i, 
nxf„ and nx^p n being a positive integer, in the down- 
san^>led form of ijl or f^4 and f^ or f^4 . Ttie pass 
roll-off characteristics of the rate converting filters 52Y, 53C 
may also be compensated by die characteristics of the half 60 
band filters 51Y and 52C Tins enables the rate coDveirsion 
to be executed reliably by the second digital processing unit 
5 of a simplified construction. 

Besides, with the present digital cam corder, the rate 
convertirig filters 52YaQd 530 for effecting rate conversion 65 
of the signals bandwidth-limited by the half band filten 51Y 
and 520 have an impulse response of an integer, coeffident 



having at least one zero point at nx2fji, nxf,, and nxf^^, and 
two zero points in the vidnity thereof so that diese filters 
may eadi be constructed by three multipliers 154 A to 1540 
and 254A to 2540. 

Besides, the half band filters 51Y, 520 for bandwiddi 
limiting die input data rate signals Y, Oj, and 0^ generated . 
by the first, digital processing unit 4, may be of a smq)lified 
structure comprising products of partial filters constituted by 
integer coeffidents. 

With die present digital cam corder, the output image 
pick-up signals R, G and B of the solid-state image sensos 
IR, IG and IB, arranged in the colOT-separating optical 
system of die image pickup unit 1 constructed m accordance 
with the spatial pixd shifting method, are digitized by the 
A/D omverting unit 3 at the predetermined phase at the f,i 
rate. At least the f,i rate digkal luminance signals Y (2f,i) 
and two f,, rate 0^ (f,i) and O^ (f,i) are generated the 
first digital processing unit 4, and rate conversion of from 2 
m to n, where m and n are positive integers, is performed by 
die second digital processing unit 5 cqiable of siting phnal 
rate conversion ratios n/m fcv gpncrating digital luminance 
signals Y (f^ having die rate of f^,,Bn/m and digital 
color difference signals Cj, (fji^) and O^ (f^) having 
substantially the ijl rate. In this manner, high qu^ity higli 
MTP £gital picture signals free beat interference and 
aliasiog distartion oompcments may be produced in accor- 
darux widi the spatial pixd shifting method. 

die present digital cam corder, the signals Y (2f,,) 
and C« (f,i) and On (f,|), generated by die first digital 
pjxwxfflrng uint 4, are converted into analog Mgn«i« by the 
EVA converting mdt 61 of the signal {Hooessing unit 6 to 
output analog luminance signals ^otir ^ analog color 
difference signals Qftour ^ ^bout» so diat faig^ resolution 
analog picture signals and Ugli MTF digital picture signab 
witb little aliasing distortion components m^ be produced 
simultaneously. Tlie signal processing unit 6 converts the 
2f^, rate digital himinanre signals Y (2f,j), generated fay die 
first digital processing unit 4, imp output analog signals by 
die D/A converting unit 61 for die recording mode, while 
converting the 2f^ rate digital himinanre signals Y (2f^, 
generated by die second (figital processing unit 5, into output 
analog signals by the D/A omverting unit 61 for die play- 
back riiode, so that high resoliition aiialog hmmiaiioe signals 
may be obtained for bodi the recording and playback modes. 

With the above-described second digital processintg unit 
5, die digital himinanoe signal Y is interfaced by the digital 
interface 13 at the dock rate of 2f^ and the digital color 
difference signals Cj^ and Cg are interfsced by the digital 
interface O at die dock rate of f^ so diat die 2f^ rate 
digital luminance signals Y (2f^ and die f^ dock rale 
digital cobr difference signals Cj^ (f^z^) and 0^ (f^) may 
be excfaanged with external equipmeoL 

Widi die present digital cam osder, die first delay com- 
pensation circuit 42pLY for compensating the group delay . 
caused by low-pass filters 63, 64 odaptsd for bandwidth- 
limiting the analog color difference signals in the analog 
encoder 62 supplied with analog luminance signals and 
analog color difference signals converted by the D/A con- 
verter 61 of the signal processing imit 6 from the signals Y, 
Oje and Og generated by die first digital processing unit 4 is 
provided at the output stage of the luminance signal diaimel . 
of die second digital processing circuit 42 of the first digital 
processing unit 4, so diat die differential delay between die 
luminance signal Y and the color difference signals C^ and 
Cb generated by die CCD image sensors IR, IG and IB of 
the image pickup unit 1 may be compensated to assure high 
quality analog picture signals. 
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With the present digital cam ooder, since the second 
delay compensating circuit 54Y for outputting the rate 
related output data rate signals Y, and generated by 
the second digital processing unit 5 with an equalized group 
delay is provided in the rate converting circuit SOY for s 
luminance signals of the second processing unit 5, the 
differential dday between the luminanoe signal Y and the 
color difference signals C^, and Cg generated by the CCD 
image sensors IR, IG and IB of the image pickup unit 1 
may be compensated to assure high quality analog picture 10 
signals. 

Besides, with the present digital cam corder, since the 
second digital processing unit 5 has the function of bidirec- 
tional rate conversion between the f^j rate related data rate 
and the f^ rate related data rate, and generates f^ rate related 15 
riflta late <tigit?^ iDminance and digital color difietence 
signals, entered from the secood delay compensation circuit 
54Y during external ir^ mode, and the f,^ rate related 
output data rate signals Y, Cj, and Cff, having the same group 
delay as that of signals Y,Cj{ and C^outputtedffom the 20 
first digital processing unit 4, to sqpply die generated signals 
to the A/D converting unit 61 of the signal processmg unit 
6, the diffomtial delay between the luminance signal Y and 
the color difference signals Cj^ and may be compeasated 
even during the external input mode to assure Mg^ quality 25 
analog picture signals. 

With the solid-state image pickup apparatus according to 
the present invention, the picture sign^ outpotted from at 
lea^ one solid-state image sensor driven at the f^i rate are 
digitized at the f,, rate at a predetermined phase by a 30 
pmrirtmrrined A/D converting unit and at least the digital 
luminanoe signals Y and two digital coto chrominance 
signals and are generated from the digitized pickup 
data by the first digital processing unit operated at die f,i 
related dock rate, so diat high quality picture signals free of 35 
beat interference m^ be pnxbiced. Besides, since the f^i 
related input data rate signals Y, Cj, and are convened by 
the second digital processing unit into signals Y, Cj^ and 
having the f^ related output data rate, the digital picture 
signals having the D-1 standard dock rate or other clock rate 40 
may be produced using a standard CCD image sensor. 

Mth die solid-^ate image pickup 2q>paratus according to 
the present invention, the second digital processor performs 
bandwidth limitation of the input data rate signals Y, Cj^ and 
C^ generated by the first (tigital processing unit, at the 45 
output data rate (^2f,i, f,, and f^|, by half band filters having 
the passbands of f^JA and f^4, while perf ormiiig the 
rate conversion of from 2f„ to f^, f^^ to f^ ix fgJA and 
from f^i to or f^4 ifor ou^inuting the low order linear 
phase finite inqmlse response to suppress the high <»der 50 
sideband component in the vicinity of nxZf^^, nxf^i and 
nxf^i, n bdng a positive integer, in die down-sampled form 

f*2. W2 or or f^4. Besides, the bandpass 

roll-off characteristics of the rate converting filter are com- 
pensated by the characteristics of the half-band filter. Uns 55 
enables the rate conversion operation to be performed reli- 
ably by the sectHid digital processing unit of a simplified 
construction. 

In the solid-state image pickup apparatus according to the 
present invention, the rate converting filter for performing 60 
the rate conversion on the signals limited in bandwidth by 
the half band filters has an impulse response of an integer 
coeffident having at least one zero poiru nx2f,,, nxf^i and 
nxfy, and two zero points in the vicinity thereof, and may be 
constructed by a plurality of multipUos. 65 

In the solid-state image pickup apparatus according to the 
present invention, the half band filter for bandwidth-limiting 
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the input data rate signals Y, Cj^ and C^ generated by the 
first digital processing unit, may be constructed in a simple 
manner by the product of partial filters constructed by 
integer coeffidenis. 

In addition, with the solid-state image pickup apparatus 
according to the present invention, since the image pickup 
signals, outputted from plural solid-state image sensors, 
arranged in the color-separating optical system in accor- 
dance with the spatial pixel sltifting method so as to be 
driven at the f,i rate, are digitized by the A/D converting unit 
at the fji rate, at a predetermined phase, the digital lumi- 
nance signals Y (2f„) having the rate 2f,, and the digital 
color difference signals C^ (f,i) and C^ (f,,) having the rate 
equal to f^^ are generated by the first digital processing unit 
so as to be processed by the second digital jHOcessing unit 
with rate conversion of from m to n, where m and n are 
positive integers, for generating the digital luminance signal 
Y (f^ having the TSt& of f^,i-n/m and the ijl dock rate 
digital color difference sigmds Cj, (fj and Cg (f^, so that 
high TMF high quality digital picture signals may be gen- 
erated widiout producing beat interference. 

What is claimed is: 

L A solid-state image pickup ^^)aratus comprising: 

a solid-state image sensor for providing image pickup 
signals at a predetermined data rate of 

analog-to-digital converting means coupled to said solid- 
state image sensor for digitizing said image pickup 
signals at a dock rate equal to fji for outputtirig digital 
image ptcfaip signals, 

first digital processing means sillied with said digital 
image pido^ signals fm providing at least a digital 
luminance signal having a data rate equal to 2f,| and 
two digital color difference signals each having a data 
rate equal to f^j, 

reoontingApeprodudng means interfaced with a dock rate 
related to f^ 

second digital processing means coupled to said first 
digital processing means and said recordirig^reproduc- 
iiig means, said second digital processing means co&- 
verting the data rate of said digital hmrinance signal 
supplied firom said first digital processing means to a 
data rate equal to f^ for ouQxitting a rate-convexted 
(figital luminance agnal to said reconling/reprodudng 
means for the recording mode. 
Z A solid state image pickup apparatus according to daim 
1, further comprising a signal processing means supplied 
with said (figital luminance signal and the two distal color 
difference signals for generating output signals, said second 
digital processing means for converting the data rate of said 
digital luminance signal sillied from said recording/rqiro- 
dudng means to a data rate equal to 2fy2 loc outputting a 
converted digital luminance sig^ and supplying said rate- 
converted digital luminance signal to said sig^ processing 
means in a playback mode. 

3. Hie solid-state image pickup ^aratus according to 
daim 1, wherein said second digital processing means is 
operable to s^ a plurality of data rate conversion ratios. 

4. The solid-state image pickup apparatus accordmg to 
daim 1, wherein said second digitsQ processing means 
comiKises: 

a filter functioning as a Nyquist filter for the dock rate of 
f^ on the digital hmunance signals having the data rate 
of 2f^i, generated by said first digital processing means, 
for outputting digital limiinance signals having a data 
rate of 2f,i, and 

a rate converting filter for performing data rate conversion 
of from 2f,, to fjj2 on said digital luminance signals 
having a data rate of 2f^i, 
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said filter having constant characteristics and said rate- 
converting filter having a variable rate-converting ratio. 

5. The solid-state image piclcup apparatus according to 
claim 2, wherein said signal processing means comprises: 

digital-to-analog converting means for converting the 5 
digital luminance signal and the two digital color 
difference signals into an analog luminance signal and 
analog color difference signals, and 

an analog encoder supplied with said analog luminance 
signal and analog color difference signals generated by lo 
said digital-to-analog converting means. 

6. The solid-state image pickup apparatus according to 
cl a i m 5 oompn smg* 

delay compensation means in a luminance signal channel 
of said first digital pirocessing means f(v conq^ensatirig is 
for a group delay caused by a low-pass filter ad^)ted fcx 
bandwidth-limiting on the analog oAor difference sig- 
nals in said analog encoder. 

7. A solid-state image pickup apparatus ccHupiising: 

a solid-state image sensor for providing image pickup 20 
signals at a pred^ermined data rate of f,i, 

analog-to-digital converting means coiq>led to said solid- 
state image sensor for digitizing said image pickup 
signals at a dock rate equal to f,i to form digital image 

pickup gignnl*^^ ~ 25 

first digital processiiig imeans supplied with the digital 
image pifdaqi signals firom said analog-to-digital con- 
verting ineaxis for providing at least a digital luminance 
signal having a dma rate related to f,| and two digital 
color diffenaice signals eadi.having a data rate rdated ^ 

reoofdingAneptoductxig means interfaced widi a dock rate 
related to f^ 

second digital processing means coiqiled to said first 35 
digital processing means and said recording^reproduc- 
ing nffians for converting the data rate of said digital 
luminance signal and the two color diffierence signals 
supplied from said first digital processing means to a 
dm rate related to f^ for generating the rate-converted 40 

. digital luminance sigiial and the rate-converted color 
diffierence dgnals, said seoood digital processmg means 
supplying the rate-converted cfigital luminance signal 
and the rate-coiiverted digital coin difference signals to 
said recradirig/keprodudng means. 45 

8. The solid state image uppsmas accordmg to claim 7, 
fiirthcr comprising signal processing means supplied with 
said digital luminance signal and the two digital color 
difference signals fw generating output dgnals, wherein said 
second digital processing means is coupled to said rec(»d- 50 
ing^reproducing means for ctmverting the data rate of the 
digital luminance signals and the digital color dififerenoe 
signals supplied thereto by said rcconfing/rcprodudng 
means to a data rate related to f^| for generating the . 
ratenoonverted digital luminance sigrials and the rate-con- 55 
verted digital color difference signals, said second digital 
processing means supplying said rate^^onverted digital 
luminance signals and saM rate^n verted digital color dif- 
ference signals to said signal processing means. 

9. The solid-state image pickup apparatus according to 60 
claim 8, wherein 

tte digital lununance signal ond the two color difference 
sigrols generated by said first digital processing means 
are outputted via said signal processing means and 
supplied via said second digit^ processing means to 65 
said teoording^reproducing means in arecosding mode, 
and wherein 



the digital lununance signal and the two digital color 
difference signals of a data rale related to f^, supplied 
fiom said recoiiling/reproducing means, are supplied 
via said second digital processing means to said signal : 
processing means in a playback mode, via which the 
signals supplied fiom said recording/rqnoducing 
means are outputted as playback signals. 

10. The solid-state image pickup apparatus according to 
claim 8, ^^izerein said si^ial processing means con^irises 
digital-to-analog converting means. 

11. The solid-state image pidoip apparatus according , to 
claim 8, wtoein said first digital processing means produces 
the digital luminance signal having a data rate of 2f,i and 
said second digital processing means performs data rate 
conversion of from 2f,, to f^ on the digital intmnamTi* signal 
having the data rate of 2f,i in a recording mode. 

12. The solid-state image pickup apparatus aooordtng to 
claim U, wherein said second cfigital processing means 
performs data rate conversion of fium f^ to 2f,, on the 
digital luminanoe signal supplied from said recofdhig^teiHO- 
dudng means in a playback mode. 

13. Tlie solid-state image pickup apparatus acomfing to 
daim 8, vdierein said first digital processing means produces 
the digital luminance signal having a data rate of 2f,i and the 
two digital color difference signals, each having the data rate 
of f^i in a recordirig mode, wd wherein said second digital 
(mxxssiiig means performs data rate conversion of finnn 2f,i 
to f^ on the digitsd hmnnance dgnal having the data rate of 
2f,j and data rate co n v e rsion of substantially from f,i to fgJ2 
on said two color di ffe reoce atgnnU having the data rate of 

14. The solid-state image pickup apparatus according to 
claim 13, wherem said second digitsd processing means 
peifuiuis data rate conversion of finom f to 2f,] on the 
digital luminance signal having the data rate equal to and 
derate conversion of substantially from to f^i on the 
two digital color diffBrraice signals having the data rate equal 
to f^ in a playback mode. 

15. The soMd state image ^iparatus according to claim 7, 
fiirther ccHniffisnkg signal processing means supplied with 
said digital luminance signal and the two digital color 
difference signals for generatiog output Mgnnln vi^iercin said 
second digi^ processing means coupled to said signal 
processing means and said recording^reproducing means for 
converting the data rate of the digital luminance signals and 
the digital color difference signals si^>plied diercto by said 
recording/reproducing means to a data rate related to f^ for 
generatiiig the rate-converted digital luminanoe signals and 
the rate-converted digital color difference signals, saki sec- 
ond digital processing means supplying said rate-converted 
digital luminance signals and said rate-converted digital 
color difference signals to said signal processing means. 

16. The solid-state image pickup , apparatus according to 
daim 15, \^ierein said first digital processing means pro- 
duces the digital luminance signal having a data rate of 2f^] 
and said second digital processing means performs data rate 
conversion of fiom 2fj, to f^ cm the digital hmnnance signal 
having the data rate of 2f,| m a recording mode. 

17. Hie solid-state image pickup apparatus according to 
daim 16, \^ierein said second digital processing means 
perfnnms data rate conversion of horn to 2f^ on the 
digital luminance signal suf^lied from said reconfing^^^xro- 
dudng means in a playback mode. 

18. The solid-state image pickup apparatus according to 
claim 17, wherein said signal processing means comprises 
digital-to-analog converting means for converting, for the 
recording mode, the digital luminance signal having a data 
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rate of 2f„. pioduced by said first digital processing means, 
into analog signals, which are outputted, said digital-to- 
anaiog converting means converting, for the playback mode, 
the digital luminance signal having a data rate of 2f^, 
produced by said second digital processirig means, into 5 
analog signals, which are outputted. 

19. Hie solid-state image pickup apparatus according to 
daim 15, wherein said first digital processing means pro- 
duces the digital luminance signal having a data rate of 2fj, 
and the two digital color diffoence signals, each having the 
data rate off,, in a recordmg mode, and wherein said second 
digital processing means perfonns data rate conversion of 
&om 2f,i to fyt on die digital luminance signal having the 
data rate of 2f,i and data rate conversion of substantially 
from f,i to f^ oa said two color difference signals having 
the data rate of f,i. ^5 

20. Hie solid-state image (nckup s^iparatus according to 
daim 19, v^ierein said second (figital processing means 
performs data rate conversion of firom f^ to 2f^ on the 
digital luminance signal having the data rate equal to f^ and 
data rate conversion of substantially from f^ to f^ on the ^ 
two digital colcnrdifiference signals having the data rate equal 

to f^ in a playback mode. 

21. The solid-state image jnckt^ apparatus according to 
daim 20, wherein said signal processing means comprises 
digital-to-analog convertiiig means fior converting, for the ^ 
recordirig mode, the digital luminance signal haviiig the data 
rate of 2f,i and die two digital color difference signals 
havxQg the data rate of f,,, {soduoed by said first digital 
processing means, into analog signals, ^i^ncfa are outputted, 
said digttal-to-analog ccsivefting means converting, for the 30 
playback mode, the digital humnance signal having die data 
rate of 2f^ and the two digital color difference signals 
having the data rate of f^ produced fay said seomd digital 
processing means, into analog signals, wMdi are outputted. 

7X The solid-state image picki^ ap par a t u s according to 3^ 
daim 20, wherein, said second digital processing means 
con^icises a filter qperated, for the recording mode, at a 
dodc rate of 2f^i and fdnctioniiig as a Nyquist filter for the 
dodc rate of 2f,| on the digital luminance signals having the 
data rate 2f,i generated by said first digital processing ^ 
ineans, said filter being opezWed. for the playback noode, at 
dodc rates of 2f^ and f^ on the digital luminance signals 
and the digital color difference signals, respectivdy, and 
presendng the same fineqiiency characteristics as in the 
recording mode, and 
a rate converting filter connected to said filter for per- 
formiiig data rate omversion of substantially from 2fji 
to f^ and data rate conversion of substantially &om f,| 
to fgJ2 on the digital luminance signals supplied via 
said filtdr and on the two digital color difference ^ 
signals, for the recording mode, respectivdy, said filter 
being used boUx for the playback mode and for the 
recording mode. 
23. A sdid-state image (ndoip apparatus comprising: 
a plurality of solid-state image sensors for providing 
image pickup signals at a predetermined data rate of f,i, 
analog-to-digital converting means coupled to said image 
sensors foe digitizing said image pickup signals at a 
clock rate equal to f^i for fonning digital image pickup go 
signals, 

first digital processing means supplied with said digital 
image pickup signals from said analog-to-digital con- 
verting means for providing at least a digital luminance 
signal having a data rate equal to 2f,| and two digital 65 
colot difference signals each having a data rate equal to 
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second digital processing means coupled to said first 
digital processing means for converting the data rate of 
said digital luminance signal and the two digital color 
difference signals from M to N, M and N being natural 
numbers, for providing a digital luminance signal hav- 
ing a data rate equal to f^ where f^2f,i*N/M, and two 
color difference signals having a data rate substantially 
equal to f^JX said second digital processing means 
having a half band filter, said half band filter having a 
passband in a range of from 0 to f^ for the digital 
luminance signal and a passband in a range of from 0 
to f^4 for die digital cdor difference signals, and a rate 
converting filter siq)plied with outputs of said half band 
filter for down-sampling the digital himinance signal at 
a data rate equal to f^ and for down-sampling the two 
color difference signals at a data rate equal to f^/1, for 
suppressing higher onler sideband components dose to 
Nx2f,„ N being a natural number. 

24. A solid-state image pickup apparatus according to 
claim 1, wherein one of said image sensors is arrayed with 
a spatial shift equal to one-half die pixd arrayiiig pitch with 
respect to die remaining image sensors. 

25. A solid-state image pidmp apparatus comprising: 

a solid-state itnage sensor for providing image pickup 
signals at a data rate equal to f^i, 

analog-to-digital convertiiig means coupled to said solid 
state image sensor for rfigitirmg said image pickup 
signals at a data rate equal to f,| at a predetermined 
I^iase to form digital image pickup signals, 

first digital processing means operated at a dock rate 
rdated to said data rate of f^j for generating, from said 
digital image pick-up signals, at least a digital lumi- 
nance signal having a data rate related to f^, and two 
digital color difference signals having a data rate 
related to f,i, 

second digital processing means for converting said digi- 
tal luminance signal having a datarate related to f^] and 
said two digital color difference signals having a data 
rate related to f,| into a digital luminance signal having 
a data rate related to f^ and two digital color difference 
signals having a data raie rdated to f^, respectivdy, 

said second digital processirig means having a half band 
filter having a passband of f^ for said digital lumi- 
nance signal from said first digital processing means 
having a data rate related to f,i, with die data rate being 
2f,i , and a passband of f^4 for said two digital color 
difference signals from said first digital processing 
means having a data rate related to f^i, with the data 
rate being f,„ and a rate converting filter for perfrmn- 
ing data rate conversion of from 2f,i to f^ cm the digital 
luminance signals supplied via said half band filter and 
down-sampling a low order linear phase finite lengdi 
impulse response siiffirient to suppress higlier order 
sideband conqxments in the vicinity of nx2f,|, where n 
is a positive integer, at a down-sampling rate of f^ for 
outputting down-sanq>led impulse response, said rate 
converting filter also performing data rate conversion 
of from (gi to f^ or f^4 on said two digital color 
difference signals supplied via said half band filter and 
down-saaq>ling a low order linear phase finite length 
impulse response suffident to suppress higher order 
sideband components in the vicinity of nxf,|, where n 
is a positive integer, at a down-sampling rate of f^ or 
fy^4 for outputting down-sampled impulse response. 

26. The solid-state image pickup a|^iaratus according to 
daim 25, wherein said half band filter has characteristics 
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whicb oofmpensate far loU-off characteristics of said rate 
converting filter. 

27. The soHd-state image pidcup apparatus according to 
daim % wheidn said rate converting filter has at least one 
zero point at nx2f^| for said digital luminance signal and at 5 
nxf^i for said two digital color diffierence signals, said rate 
converting filter also having each two zero points in the 
vidnity thereof. 

28. The soHd-state image pickup apparatus according to 
daim 25, wherein said rate converting filter comprises a lO 
plurality of multipliers. 

29. The soHd-state image pickup qjparatus acctsding to 
daim 25, wherein said half band filter oonqxises a product 
of partial filters each ccHistituted by integer coefficients. 

3Q. A soHd state image pickup apparatus comprising: 15 

a phxraliQr of soHd-state image sensors for providing 
image pidcup signals at a predetermined data rate of f^i, 
at least one of said image sensors being arrayed with a 
spatial shift equal to one-half the pixd arraying pitch 
with respect to the remaining image season, ^ 

analog*to-digital converting means for digitizing said 
image pickup signals at a dock rate equal to f^, for 
forming digital image pickup signals, 

first digital pioce^iiig means supplied with said digital ^ 
image pidmp signals from said analog-to-digital con- 
veitmg means for providhxg at least a digital hmunance 
signal having a data rate equal to 2f,i and two digital 
color difiiBrence signals each having a data rate equal to 
f,i»and - 30 

second digital processmg means coupled to said first 
digital processing mcaiis for convertkg the data rate of 
said digital luminance signal and the two digital color 
difference signals from M to N, M and N being natural 
ruunbers, for providing a digital luminance signal hav- 
ing a data rate equal to f^ where f,2=<tf,,-N/M, and two 
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color difference signals haying a data rate substantiaUy 
equal to f^, and 
tMrd digital processing means coupled to said first digital 
processing means for processing said digital luminance 
signal and the two digital color difference signals to 
output processed signals to an external device. 

31. The solid-state image pidoip apparatus according to 
daim 30. wherein said second digit^ processing means 
mdudes a half band filter having a passband in a range of 
from 0 to f^ for the digital himinance signals md a 
passband in a range of frran 0 to f^4 for the digital color 
difference signals, and a rate convening filter siqjplied with 
outputs of said half band filter fcM- down-sampling the digital 
luminance signal at a data rate equal to f^ and fcr down- 
sampling the two color difference signals at a data rate equal 
to f^jfl, for suppressing higher order siddKind cooqxments 
dose to Nx2f,|, N being a namral number. 

32. The solid-state image pickup apparatus aocordipg to 
claim 30, wherein said second digital processmg means is 
operative to set a plurality of rate convosion ratios. 

33. Ibe solid-state image pickup apparatus according to 
daim 30, fimha- comprising lecording/reprodudng means 
interfaced widi said second digital isocessing means at a 
dock rate related to fs^- 

34. Ibe soHd-state image pickup apparatus according to 
claim 30, wherein said thhd digital processing means 
indudes digital/analog converBion means for converting 
said digital luminance dgnal and the two digital color 
diSierence signals to an analog luminance signal and to 
analog cdOT diffiercnce signals, respectivdy. 

35. The solid-state wnnga p i<*Jqtp appsistos accoidiiig to 
daim 30, wherein said second digital processmg n^ans is 
operative to downnconven die data rate of said digital 
luminance signal and the two digital color differeoce signals 
frwn M to N. 

♦ • ♦ ♦ • 



